DOCUMENT RESUME 



ED 429 519 


HE 032 Oil 


AUTHOR 


Dey, Eric L. ; Hurtado, Sylvia; Rhee, Byung-Shik; Inkelas, 
Karen Kurotsuchi; Wimsatt, Leslie A.; Guan, Fenghua 


TITLE 


Improving Research on Postsecondary Student Outcomes: A 
Review of the Strengths and Limitations of National Data 




Resources . 


INSTITUTION 


National Center for Postsecondary Improvement, Stanford, CA 


SPONS AGENCY 


Office of Educational Research and Improvement (ED) , 
Washington, DC. 


REPORT NO 


NCPI-5-01 


PUB DATE 


1997-00-00 


NOTE 


134p . 


CONTRACT 


R309A60001 


PUB TYPE 


Information Analyses (070) -- Reports - Descriptive (141) 


EDRS PRICE 


MF01/PC06 Plus Postage . 


DESCRIPTORS 


*College Faculty; College Instruction; *College Outcomes 



Assessment; Data Analysis; *Data Collection; Educational 
Assessment; Higher Education; Learning Processes; 
*Longitudinal Studies; *National Surveys; Research 
Methodology; ^Student Surveys 

IDENTIFIERS As tin (Alexander W) ; * Input Environment Outcome Model 



ABSTRACT 



This report analyzes existing national data sets to 
determine their utility in studying teaching, learning, and assessment issues 
as they affect postsecondary student outcomes. The analysis used Astin's 
Input “Environment -Outcome model to evaluate student and faculty databases 
that are intended to be nationally representative, are recent or continuing, 
have a major focus on undergraduate postsecondary participation, and cover 
teaching and learning topics. The seven student-centered data sets reviewed 
are: Baccalaureate and Beyond Longitudinal Study; Beginning Postsecondary 
Student Longitudinal Study; High School and Beyond; National Education 
Longitudinal Study of 1988; National Longitudinal Study of the High School 
Class of 1972; National Postsecondary Student Aid Study; and Recent College 
Graduates Study. Also reviewed are four iterations of the Cooperative 
Institutional Research Project surveys. Faculty-centered data sets included 
are the American Council on Education Faculty Survey, the Higher Education 
Research Institute Faculty Survey, and the National Study of Postsecondary 
Faculty. Strengths and limitations of each data set are discussed and data 
sets are compared for inputs, teaching/learning, environments, and outcomes. 
Attached tables detail study findings. An appendix summarizes limitations of 
the data sets cited in empirical studies. (Contains 25 references.) (DB) 



★★★★★★★★★★★★★★★★★★★★★★★★★★★★★★*********************************************** 

* Reproductions supplied by EDRS are the best that can be made 

* from the original document . 



ED 429 519 






f 



Improving Research on ^ f f 
[Postsecondary Student Outcomes: ^ | 

A Review of the Strengths 
and Limitations of 
National Data Resources 



ERIC L . D E Y 

SYLVIA HURTADO 

BYUNG-SHIK RHEE 
KAREN KUROTSUCHI INKELAS 
LESLIE A. WIMS ATT 
FENGHUA GUAN 






lEST COPY AVAILABLE 



U.S. DEPARTMENT OF EDUCATION 
OfJice of Educational Research and Improvement 
EDUCATIONAL RESOURCES INFORMATION 
/ CENTER (ERIC) 

(tl/H his document has been reproduced as 
received from the person or organization 
originating it. 

□ Minor changes have been made to 
improve reproduction quality. 



National Center 
for Postsecondaiy Improvement 



• Points of view or opinions stated in this 
document do not necessarily represent 
official OERI position or policy. 



ERLC 



Stanford Universitv ♦ School of Educ^uion ♦ 520 Galvez Mall, 508 CERAS ♦ Stanford, CA 94305-,3084 








NCPI 

' National 
Center for 
Postsecondary 
Improvement 



Improving Research on 
Postsecondary Student Outcomes: 
A Review of the Strengths 
and Limitations of 
National Data Resources 



ERIC L . D E Y 

SYLVIA HURTADO 

BYUNG-SHIK RHEE 
KAREN KUROTSUCHI INKELAS 
LESLIE A. WIMSATT 
FENGHUA GUAN 



National Center for Postsecondary Improvement 
508 CERAS 
School of Education 

Stanford University, Stanford, CA 94305-3084 
© 1997 National Center for Postsecondary Improvement 

The work reported herein was supported in part by the Educational Research and Development Center program, agreement 
number R309A60001, CFDA 84.309A, as administered by the Office of Educational Research and Improvement (OERI), U.S. 
Department of Education. The findings and opinions expressed in the report do not reflect the position or policies of OERI or the 
US. Department of Education. Publication Number NCPTS'Ol. 



3 



Improving Research on Postsecondary Student Outcomes: 

A Review of the Strengths and Limitations of National Data Resources 



Eric L. Dey 

Karen Kurotsuchi Inkelas 



Sylvia Hurtado B 50 ing-Shik Rhee 

Leslie A. Wimsatt Fenghua Guan 



Center for the Study of Higher and Postsecondary Education 
University of Michigan 



Reviewing and synthesizing published research is a routine, yet critical, scholarly activity. 
Such reviews help document the current state of knowledge in particular fields of scientific inquiry 
while also sending to articulate themes and identify frameworks that are generated across a variety 
of studies. Although different "approaches to gleaning the accumulated findings of... research" 
have been suggested (Dunkin, 1996, p 87), it is clear that such reviews influence research, policy, 
and practice and are important in helping develop and advance knowledge. 

The purpose of this analysis is to review existing national data sets to determine their utility 
in studying teaching, learning, and assessment issues. We approached this review as one might 
approach a review of a body of literature, substituting data bases and variables for books and 
articles. In doing so, we seek to review, compare, and contrast the strengths and limitations of 
existing national data resources on postsecondary education. The results of this review will help 
document the existing capacity to study teaching, learning, and assessment activities with existing 
data resources, while also suggesting directions and priorities for future data collection activities. 

The specific focus of this review is on topics related to studying how teaching and learning 
processes affect postsecondafy student outcomes. Interest in assessing the outcomes of 
undergraduate education and other forms of postsecondary activities has continued to grow in 
recent years. Unfortunately, the increased demand for empirical evidence on the relationship 
between teaching, learning, and assessment and student outcomes across the American 
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postsccondary system has largely remained unmet. Despite continuing investments in the 
production and maintenance of data systems at the institutional, state, and national levels, the data 
that are currently available tend to be limited in a number of ways. As has been observed 
elsewhere, "Much of the business of education occurs in the nation's classrooms - elementary, 
secondary, and postsecondary - yet national surveys presently tell us relatively little about what 
actually takes place at the classroom level" (National Center for Education Statistics, 1996, p. 16). 

Thematic organization 

In conducting our review, we focused primarily on data collected from students 
participating in some form of postsecondary education. Since faculty activity is an obvious 
component of teaching and learning in postsecondary education, we reviewed a number of faculty 
data bases as well but our primary effort was directed toward the student data set. 

Data on students 

We drew upon a number of existing frameworks as an aid to organizing our work. As a 
general organizational tool, we used Astin’s (1970) Input-Environment-Outcome (lEO) model for 
studying college impact. At its most general level, the lEO model is useful in that it identifies a 
number of different kinds of student data - inputs, environments, and outcomes - that are needed 
in order to adequately assess the degree to which educational environments are influencing the 
outcomes measured among participating students. This model, which is depicted in Figure 1, 
underscores the need to collect detailed data on student characteristics (e.g., demographic, 
cognitive, attitudinal, and behavioral) before college ("inputs"), the educational environment in 
which students participate ("environments"), as well as the outcomes of interest. Attempts to 
assess questions of environmental influence can be seriously flawed if they ignore relevant data in 
one or more of these categories of data (see Astin, 1970; Astin, 1991). 
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Figure 1 

Astin’s Input-Environment-Outcome model 



The lEO model is important in that it identifies the kinds (or groupings) of data needed for 
sound analyses of educational impact. It is, however, limited for the purpose of reviewing existing 
data resources given the wide variety of variables that might be included in each of the three main 
categories. As such, we used a strategy employed in a recent work by Terenzini (1997) as the basis 
for identifying and developing relevant sub-categories within each of the three main elements of 
Astin's framework. For example, Terenzini identified a series of student outcomes from which we 
then adapted and created a format for analysis. Some of the outcomes categories were obtained 
directly from Terenzini's taxonomy, while we created other categories specifically for the purpose 
of this review. In addition, we divided the input and environmental classes of data into categories 
based upon variables commonly found in the existing college impact literature (Pascarella & 
Terenzini, 1991). 

As shown in Table 1, we divided the general input class of student data into four 
subcategories - Pre-postsecondary educational activities, student goals and values, personal, and 
family characteristics - which were in turn broken down into more detailed subcategories. For 
example, educational activities were further subdivided so that individual activities, organized 
activities, and other types of activities were grouped together. Under these subcategories (and finer 
groupings of variables) the specific definitions that were used to classify variables into the thematic 
categories are shown. 
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Despite the advantages presented by the general nature of the ffiO framework, the 
complexities of teaching and learning processes are such that a number of potentially relevant 
variables fail to cleanly fall in only one class of data. An example of such a grouping is the 
Teaching and Learning categoiy represented on Table 1. Given that teaching and learning variables 
as defined here can be seen as encompassing a number of categories, we have chosen to represent 
these kinds of variables as a separate categories (as opposed to forcing them into one category or 

another). 

It should be noted at the outset that a universally-useful definition of “outcome” is lacking 
and a wide variety of measures and needs exist. Some institutions measure outcomes such as 
student attitudes, concept mastery, and student performance (Laws, 1991), while others assess 
critical thinking skills (White, 1988). Similarly, researchers have studied topics ranging from 
student satisfaction and involvement with peers, faculty, and course work (Astin, 1991) to 
occupational choices and employment outcomes (Adelman, 1994). This variety is a reflection of 
the many goals that postsecondary institutions have for themselves and for their students, and the 
ways in which different interest groups view postsecondary education and its role. 

For the purpose of this review, we have attempted to include as many possible definitions 
of different classes of student outcomes (as well as input and environmental considerations) as 
practical. We do not, however, claim that our approach has generated a list that is entirely 
comprehensive, nor one that equally represents all views about the important outcomes of 
postsecondary education. Nevertheless, our intent in undertaking this study is to provide a first 
step toward assessing the ability of present national data sets on postsecondary education to 
provide information on student outcomes as a springboard for future empirical research and policy 

initiatives. 

Data on faculty 

Viewed from the perspective of students, the activities and orientations of faculty help 
constitute the environment within which students study and learn. Although it is conceivable to 
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study faculty using data collected through a variety of research designs, from the student- 
environment perspective it is most advantageous to concentrate on data bases where data were 
collected so that faculty respondents are clustered within institutions (as opposed to simply taking a 
random sample of respondents from the entire population of faculty). This clustered approach 
allows the potential for studying an institution's instructional climate (and ideally the specific 
institutional and assessment techniques to which students are exposed). 

But in addition to providing an environment for students, data collected from faculty can be 
used to study how teaching activities and other faculty-related topics are related to faculty 
characteristics and institutional context. As such, we developed the thematic categories found in 
Table 2 to organize our review of faculty data. Although this categorization scheme is not tied to a 
framework such as lEO, it does capture the types of variables that are commonly found in studies 
of postsecondary faculty (e.g., Finkelstein, 1984). 



Methodology 

The first step in performing our review was to identify as many potential data bases as 
possible. In order to do this, we systematically collected information on existing data bases by 
contacting research organizations and governmental agencies, reviewing printed publications on 
data collection activities and plans, as well as information available via the Internet. Specifically, 
we contacted and reviewed materials from relevant federal agencies (e.g.. Census Bureau, 
Department of Education, Department of Labor, and the National Science Foundation), academic 
research organizations (e.g., UCLA Higher Education Research Institute, the University of 
Michigan's Institute for Social Research), and private foundations such as the Carnegie Foundation 
for the Advancement of Teaching. In addition, we reviewed the holdings of the social science data 
base archives maintained by the Inter-University Consortium of Political and Social Research 
(ICPSR). All told, we identified 27 individual-level data bases that appeared to have some 
relevance for the study of teaching, learning, and assessment practices as they relate to the 
outcomes of postsecondary education. 
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From this pool of data bases, we narrowed our choices by selecting only those data bases 
that are intended to be nationally representative, are recent or continuing, have a primary (or 
potentially strong) focus on postsecondary participation at the undergraduate level, and that have 
some coverage of teaching and learning topics within the context of postsecondary education. 

Using these criteria, we chose eleven data sets where individual students are the unit of analysis. 

and five where individual faculty are the unit of analysis. 

Data bases that were originally considered and then excluded on the basis of representation 
include the 1992 National Study of Student Learning conducted by the former National Center for 
Postsecondary Teaching. Learning, and Assessment (which has a limited representation of 
institutional types), the National Science Foundation’s Recent College Graduate studies (which are 
nationally-representative of scientists and engineers but not of graduates in other fields), and 
normative data from the College Student Experiences Questionnaire developed by C. Robert Pace 
and now coordinated through Indiana University. Three additional data bases were excluded due to 
a lack of coverage of teaching and learning topics. These included the National Longitudinal 
Survey of Youth from Ohio State University through the sponsorship of various federal agencies, 
the General Social Survey conducted by the National Opinion Research Center, the Monitoring the 
Future study, and the Panel Study of Income Dynamics (the latter two of which are conducted by 

the Institute for Social Research at the University of Michigan). 

The Longitudinal Study of American Youth conducted by Northern Illinois University and 
the Chicago Academy of Sciences was considered potentially relevant, but the data base and 
associated documentation was unavailable during the period of the review. One series of faculty 
data (from the Carnegie Foundation for the Advancement of Teaching) was also considered but 
excluded from review on the basis of its research design. As noted above, one mam use of faculty 
data is to provide information on the faculty environment at postsecondary institutions. The 
random sampling design used in the Carnegie surveys eliminates this possibility, and we therefore 
chose not to review it even though it otherwise met the criteria we established. Moreover, a review 
of the content of recent Carnegie survey showed a good deal of overlap with the faculty surveys 
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that we did review. As with the characteristics of the other excluded data bases noted above, these 
considerations are limitations only for the purpose of our review, and are not lirmtations inherent in 
the data bases or studies themselves. 

Most of the data sets we reviewed for this study are administered by the U.S. Department 
of Education National Center for Education Statistics (NCES), with the balance being administered 
by the UCLA Higher Education Research Institute (HERJ). Most student data sets of interest are 
longitudinal. The time span of each data set varies from one year to sixteen years. In contrast, all 
faculty data sets are cross-sectional. Each data set has its distinctive features in terms of primary 
focus, subjects, sample size, and availability of information on oversample or breakout of minority 
groups. The last category was especially designed to meet the needs of researchers who are 
interested in studying Latino or Asian American students. In cases where the student data set 
included supplementary information collected from respondents’ parents, high school teachers, or 
high school or postsecondary institutions, our analysis is mostly limited to the data collected from 
the primary student respondents. 

Data sets reviewed 

The data sets we reviewed are summarized in Table 3 and described below. We reviewed 
seven student-centered data sets from the National Center for Education Statistics (NCES) in the 
U.S. Department of Education. These included; Baccalaureate and Beyond Longitudinal Study 
(B&B); Beginning Postsecondary Student Longitudinal Study (BPS); High School and Beyond 
(HS&B); National Education Longitudinal Study of 1988 (NELS); National Longitudinal Study of 
the High School Class of 1972 (NLS-72); National Postsecondary Student Aid Study (NPSAS); 
and Recent College Graduates Study (RCG). In addition, we analyzed data from four different 
iterations of the Cooperative Institutional Research Project (CIRP) surveys that are administered by 
the Higher Education Research Institute at UCLA. All the CIRP surveys critiqued are longitudinal, 
and include coverage from; 1971-1980; 1985- 1989; 1986-1990; and 1987-1991. The CIRP data 
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sets reviewed do not reflect the totality of the data resources maintained by CIRP, but are the only 
data sets available to us. 

The National Longitudinal Study of the High School Class of 1972 (NLS-72) has the 
longest time frame among the student data sets (sixteen years) and focuses on transitions from high 
school to college and/or to work. A unique characteristic of this data set comes from the sampling 
strategy, which is designed to include both postsecondary participants and non-participants. Other 
survey studies under review gathered data from either high school students or college students, 
which may impinge on statistical inference of college impact on students due to the selection bias. 
The first wave of data collection began in 1972 with a 12th grade cohort, and includes follow-ups 
in 1973 1974, 1976, 1979, and 1986. African American students are oversampled, and an ethnic 

group breakout of Latinos is available. 

High School and Beyond (HS&B:80/92) is comparable to NLS-72 in terms of its data 
structure. It attempted to collect the same type of data gathered in the NLS-72, with newer elements 
of the educational process. HS&B provides information on educational, vocational, and personal 
development as well as on the transition from high school to postsecondary education or to the 
workforce. It includes a sophomore cohort as well as a senior cohort in 1980. Data collections for 
the follow-ups were undertaken in 1982, 1984, 1986, and 1992. Hispanic students are 
oversampled, and an ethnic group breakout of Asian Americans is available. 

The National Education Longitudinal Study of 1988 (NELS:88/94) provides trend data on 
the transitions students encounter as they progress through their elementary, secondary, and 
postsecondary education or the work force. The NELS is also comparable to the NLS-72 and 
HS&B in terms of data structure. It began in 1988 with 8th grade students, and follow-up studies 
were conducted every two years until 1994. Asian Americans and Latinos are oversampled, and an 

ethnic group breakout of Asian Americans and Latinos is available. 

The National Postsecondary Student Aid Study (NPSAS) is a cross-sectional data set. It is 
a comprehensive nationwide study of students enrolled in less-than-two-year institutions, 
community and junior colleges, and four-year colleges and universities. Undergraduate, graduate. 
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and first-professional students who receive financial aid, as well as those who do not receive aid, 
are included in the NPSAS. A large portion of the data set consists of financial information. The 
NPSAS also includes information on employment and educational aspiration. Data collection began 
in 1986, and was repeated every three years. It is notable that NPSAS has two longitudinal sub- 
components: the Beginning Postsecondary Student Longitudinal Study (BPS) and Baccalaureate 
and Beyond Longitudinal Study (B&B). 

The Beginning Postsecondary Student Longitudinal Study (BPS) focuses on student 
persistence, progress and attainment. It began in 1990 as a longitudinal component of the NPSAS 
with beginning students in college. Its sample size is approximately 7,900 first-time postsecondary 
students in 1990, and these students were followed-up in 1992 and 1994. A unique feature of BPS 
is that it includes “non-traditional” students, or a heterogeneous sample of students by age. An 



ethnic group breakout of Asian Americans is available. 

Baccalaureate and Beyond Longitudinal Study (B&B), which is another longitudinal 
component of NPSAS, replaced the Recent College Graduates Study (RCG). B&B pays special 
attention to those entering public service areas, particularly teaching. It focuses on education and 
work experience and transition to graduate school and/or the work force. Data collection began in 
1993, and one follow-up study was conducted in 1994. An ethnic group breakout of Asian 
Americans is available. 

The Recent College Graduates Study (RCG) focuses on graduates qualified to teach at the 
elementary and secondary school level. It is a study of the immediate post-degree employment and 
educational experiences of people who obtained a bachelor’s or master’s degree from an American 
college or university. The RCG is a cross-sectional study with graduates within one year of 
attaining a bachelor’s or master’s degree. The RCG has been conducted periodically since 1976. 
This study analyzes the 1991 RCG with 14,405 graduates. African Americans and Hispanics were 
oversampled for the study. 

The Cooperative Institutional Research Program (CIRP) is a longitudinal study of the 
impact of different types of college environments on a student’s development. The survey design 
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of the CIRP is based on the Input-Environment-Outcomes model suggested by Astin. This study 
analyzes only four data set iterations, which include 1971-80. 1985-89, 1986-90, and 1987-91. 

The questions included in each study are slightly different, but a primary focus is placed on a 
student’s cognitive and psycho-social development in college. The time span of the studies is 
consistently four years, except for the CIRP 71-80. A Latino breakout is available for CIRP 87-91. 

Minority students were oversampled for CIRP 71-80. 

The data sets we reviewed with faculty members as the unit of analysis included the 
American Council on Education Faculty Survey (ACEFAC-72); two cohorts (1989 and 1992) from 
the Higher Education Research Institute Faculty Survey (HERIFAC-89; HERIFAC-92); and two 
cohorts (1988 and 1993) from the NCES National Study of Postsecondary Faculty (NSOPF-88; 

NSOPF-93). 

The National Study of Postsecondary Faculty (NSOPF) is a cross-sectional survey of 
25,780 full-time and part-time postsecondary faculty members. The NSOPF was administered by 
NCES in the 1987-1988 academic year, and repeated in the 1992-1993 academic year. It provides 
information on the background, responsibilities, workloads, salaries, benefits, and attitudes of 
faculty in their postsecondary institutions. The faculty survey conducted by the Higher Education 
Research Institute is also a cross-sectional survey that includes 35,480 faculty members in 1988- 
89 and 43,940 in 1991-92. A unique feature of these studies is the similarity of questions between 
the CIRP student and faculty surveys. Finally, the 1972 American Council on Education survey 
collected data from 53,034 respondents working at 301 colleges and universities. Although not 
particularly recent, the ACE-72 study is similar in design to the later HERI surveys and was 
therefore included. 

The review process 

Our multi-step review procedure was accomplished in three phases. First, teams of 
researchers divided up the data sets in the sample and categorized all of the variables within the data 
sets into agreed upon thematic categories. Next, each team exchanged their reviews with the other 
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team and scrutinized the categorization strategies employed by the other group. Any differences in 
opinion pertaining to the placement of specific variables within the thematic categones framework 

were discussed mutually and revisions were made accordingly. 

The number of variables (constructs) falling within each subcategory were then tallied in 
order to provide a basic summary of how well the subcategory was represented in each data set. 
These tallies were then divided into four levels of representation: Not represented. Limited 
representation (fewer than six variables). Represented (six to ten variables), and Well-represented 
(eleven or more variables). These representation cut-off points provide some basic descriptive 
information on how well each subcategory is represented in each of the data sets we reviewed. 
However, individual researchers may find that a data set with a "limited represention" of a certain 
category may be ideally suited for an analysis if the key variable of interest is included. Similarly, a 
data set that has strong representation in a certain category may not be at all useful for a particular 
purpose if a specific variable is not available from the data base. 

At the same time, the review team also had the option of filling out index cards with 
information gleaned from the data sets that may not have been readily apparent through the thematic 
category approach. These index cards were later collected and then summarized into a matrix of 
themes arranged by data set. 

These two systems complimented each other, in that the thematic category framework, or 
variable-by-variable approach, provided a more micro-view of the data sets, while the index 
cards/matrix approach contribute to a more macro-approach, since it allowed the researchers to 
make linkages across data sets and point out strengths/weaknesses/uniqueness among the 
respective data sets. 

Finally, the research team has collected published empirical research studies that utilized the 
data sets outlined above and scanned the studies for any information pertaining to theoretical or 
methodological limitations to their studies due to the data sets. 
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Limitations of the review 

Before proceeding to an overview of the findings from the data set review, it is important to 
recognize a number of important limitations. We have reviewed the data sets from the perspective 
of researchers interested in understanding teaching, learning, and student development processes. 
However, a number of the data sets we reviewed may not have been designed to capture these 
processes but were included in the review because they met the basic criteria we established for 
data set selection. Thus, while a certain data set may be limited when viewed through the lens we 
have employed in this review, this should not be taken as evidence of a general limitation of the 
data. In fact, the data set may have very effectively achieved its primary goals, but is simply not 
ideal for a secondary analysis looking at teaching, learning, and assessment issues. 

One issue that is not explicitly considered in this review is data quality. Within the general 
context of survey research, data quality has many different aspects that involve a number of trade- 
offs (Groves, 1989). In the specific context of the data sets that we reviewed, there are issues 
ranging from more obvious considerations such as response rates (which, for example, are much 
higher for the data sets collected by NCES than those achieved by CIRP) to issues of reliability and 
validity of recall and self-report measures. As such, the student and faculty matrices should be 
interpreted with caution, especially with regard to psychological constructs, because it was 
primarily developed based on face validity. The relationship among the items of each subcategory, 
such as academic activities and values, was not empirically examined. Therefore, the tallies within 
each thematic category simply provides an indication that measures related to the thematic category 
content area were available on the data set; the measures were not further investigated. 

The student data sets we reviewed varied in terms of their longitudinal design that has 
implications for the way that outcomes can and are defined. For example, a number of the CIRP 
data sets are limited in that they are only four-year follow-ups (although longer-term follow-ups are 
possible). If "outcome" is defined to focus on short-term cognitive and attitude development, this 
data structure may not be problematic. On the other hand, if the relevant outcome is related to 
occupational attainment, a much longer-term design would be stronger. Given the diversity of 
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potential postsecondary outcomes that are viewed as important, we have chosen to be flexible in 
terms of definition of outcomes, and emphasize the inherent strengths and limitations of each 
particular data set. 

Finally, our review focused on the data sets collected via survey techniques. As such, 
supplemental data such as student transcripts are noted but not analyzed. Such collections, 
available for a number of NCES data bases, are rich additions to basic survey data and have led to 
interesting analyses (Adelman, 1993), but are beyond the scope of the present review. 



Results 

In describing the strengths and limitations that we observed, we have organized our 
comments according to the thematic categories we established above. In a number of cases, the 
data sets were not sufficiently focused on the topics covered by the review and are therefore 
succinctly summarized. All of the data set review observations are summarized in Tables 4 (student 
data sets) and 5 (faculty data sets), and described in more detail in the following sections. These 
observations center specifically upon the purpose of this investigation - namely the utility of the 
data in studying student outcomes produced by students’ educational activities, contextual factors, 
and teaching and learning processes - and should not be interpreted for application beyond these 
parameters. 



Strengths and Limitations of Individual Student Data Sets 
Beginning Postsecondary Student Longitudinal Study (BPS) 

The BPS, a longitudinal study, is a component of NPSAS with beginning students in 
college. Data collection started in 1990, and follow-up surveys were conducted in 1992 and 1994. 

College transcript data supplements are planned. 

The BPS is weak in areas related to high school educational activities. It has no information 
pertaining to individual academic and social activities and organized curricular, co-curricular, and 



Review of national data resources 

Page 14 



extra-curricular activities. However, the BPS is rather strong in terms of the respondents’ pre- 
college goals and values; it has good representation on variables related to attitudes/values, self- 
esteem, educational/career aspirations, reasons for attending college, and choice or application 
behaviors. Conversely, the BPS is relatively weak in areas related to high school characteristics 

and achievement. 

The BPS only contains information about the respondents’ SAT or ACT scores, but does 
not include high school grade information. The BPS has no representation in key personal and 
family constructs such as English proficiency, information on drug use, religion, family relations, 
and parental involvement in the respondents’ upbringing and education. However, it does include 
information on the respondents’ disabilities, financial assets or liabilities, and socioeconomic 
status-including a listing of household items owned. In terms of teaching or learning constructs, 
the BPS data set only includes variables related to respondents overall satisfaction with their 

instruction and learning development during college. 

With regard to individual academic, social, and co-curricular activities, the BPS provides 
only limited representation. Curricular and extra-curricular activities are better represented. The 
BPS also has only limited representation with regard to faculty contact or interaction; however, 
there is abundant information on interaction and satisfaction with student services. Institutional 
characteristics are well represented in this data set, while the respondents’ impressions of college 
are adequately represented. Enrollment and tuition/expense information is also well represented. 

One of the strengths of the BPS pertains to information in relation to employment activities. 
The BPS contains information concerning employment while enrolled, employment while not 
enrolled, and job related training and/or courses. The main strength of the BPS, though, pertains to 
the wealth of information it has on a respondent's financial aid status. The data set also includes 
information on why respondents did not apply for financial aid, information on parents’ activities 
in relation to the respondents’ financial aid status, and general financial indebtedness. 

In terms of student outcomes, while the BPS is well represented with information on the 
respondents’ college achievement, it lacks information on psychosocial development and views on 
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social issues. Civic behaviors such as political behaviors and volunteer work are well represented 
in the BPS, which is a particular strength of this data set. In addition, the BPS is well represented 
in terms of variables relating to aspirations, retention, and satisfaction. 

Baccalaureate and Beyond Longitudinal Study (B&B) 

The B&B is another longitudinal component of NPS AS. Those who pursue a teaching 
career receive special attention in this data set. The B&B replaced the Recent College Graduates 
Study (RCG). College transcript data supplements are planned. 

This data set provides detailed information on a student’s college choice/application 
behavior, high school achievement, social economic status, and financial assets and wealth. 
Students’ activities in college, including academic, social, curricular and extra-curricular activities, 
are also well represented. Students’ employment information while they are enrolled, job related 
training/courses and interaction with student services are also available. In addition, the data set has 
many variables describing institutional characteristics, students’ enrollment, financial aid, and 
tuition/expenses. With regard to outcomes, students’ college achievement, psycho-social 
development, views on social issues, aspirations, and success in transition to work or graduate 

school are well represented. 

One of the main limitations of the data set is its lack of information on teaching/leaming 
styles or processes. No variables are provided to describe teaching/leaming during the students’ 
college education. In addition, information on students’ educational activities before college is 
limited. Students’ family relations, religion, impression of college, and civic behaviors (political 
behaviors and volunteer work) after college are also absent. Further, an important element of 
student outcomes assessment, student satisfaction with college education, is not represented. 

Cooperative Institutional Research Project (CIRP) 

All the iterations of the CIRP included in this study are longitudinal surveys, which 
typically involve data collection from first year students who were followed-up four years later. 
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except for the CIRP71-80 which was a nine-year follow-up study. All versions (71-80, 85-89, 86- 
90, and 87-91) of the CIRP include variables that represent high school educational and extra- 
curricular activities of both an individual and organized nature. However, CIRP 71-80 has more 
limited availability of constructs related to individually-oriented academic and social activities, as 
well as organized curricular, co-curricular, and extra-curricular activities. Institutionally-provided 

transcript data are not available. 

In terms of the pre-college goals and values of respondents (e.g., attitudes/values, self- 
esteem, reasons for attending college, and educational/career aspirations), all versions of the CIRP 
are well represented, but college choice or application behaviors have a limited representation in the 

CIRPs 86-90 and 87-91. 

All versions of the CIRP contain limited amounts of information about the characteristics of 
respondents' high schools and the academic achievement of the respondents. However, versions 
86-90 and 87-91 are well represented with regard to high school achievement. The CIRP data 
bases are not particularly strong in terms of personal information (that is, drug use, English 
language proficiency, and disability status) about the respondents. For example, only the 87-91 
version contains any information about the English proficiency of the respondents, and only asks 
one question related to this issue. There is also no information about the respondents’ drug usage. 
Finally, only the 86-90 and 87-91 versions of the CIRP contain information about the respondents’ 

disabilities, if any. 

While all versions of the CIRP are not strong in terms of personal information about the 
respondents, all of the versions of the CIRP do at least have some information about the 
respondents’ socioeconomic status, except the 71-80 is slightly more represented in this area. 
Further, all of the versions have information pertaining to the religion of the respondents, with the 
86-90 and 87-91 being slightly better represented on this issue. Only the 86-90 and 87-91 versions 
of the CIRP have information concerning the respondents’ (or their parents ) financial assets and 
liabilities. However, none of the versions contain any information about the respondents family 
relations or parental involvement in their upbringing or education. The CIRP 85-89 contains the 
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best representation of variables related to teaching processes, but all of the iterations of the CIRP 
are relatively limited in this area. 

The CIRP data sets (all versions) are particularly strong in terms of college activities of an 
individual (academic and social) and organized (co-curricular and extra-curricular) nature, with the 
following exception; the 71-80 has only limited representation with respect to co-curricular 
activities. All versions of the CIRP have only limited information about the respondents’ curricular 
activities and employment status during college, and have no information on employment 
undertaken while the respondent was not enrolled. Similarly, all versions lack information on job- 
related training and/or courses. 

With each subsequent version of the CIRP, more questions were included which relate to 
student-faculty contact or interaction. While the 71-80 and 85-89 versions have only limited 
representation in relation to faculty contact, the 86-90 is adequately represented and the 87-9 1 is 
well represented in this area. All versions of the CIRP are represented in terms of variables relating 
to the respondents’ interaction and satisfaction with student services. 

All versions of the CIRP are well represented in terms of overall characteristics of the 
postsecondary institutions attended as well as the respondents’ impressions of the institutions. The 
71-80 and 85-89 versions are better represented in terms of student provided information on course 
enrollment patterns than the 86-90 and 87-91. While all versions of the CIRP are strong in relation 
to information about financial aid, none of the versions have any constructs concerning tuition or 
other related expenses. 

Constructs related to the respondent's college achievement, psycho-social development, 
and views on social issues are well represented in all versions of the CIRP. While the other 
versions lack representation with respect to political behaviors and volunteer work, the 87-91 has 
limited representation in these areas. All versions are strong in terms of questions relating to future 
occupational and educational aspirations. However, with the exception of 71-80, none of the 
versions contain any information on success in transition to work or graduate school. Finally, all 
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versions of the CIRP are well represented in terms of measures of retention and satisfaction with 
college. 

High School and Beyond (HS&B) 

The HS&B has a similar longitudinal data structure to the NLS-72, but includes broader 
measures of the educational process. The survey design of HS&B has a number of strengths, 
including the existence of a non-college going sample, several waves of follow-up data, and the 
fact that two different cohorts are being followed simultaneously. High school and college 
transcript data are available. 

This data set contains abundant information on the input elements. Students academic, 
curricular, extra-curricular, attitudes/values, self-esteem, educational/career aspirations, reasons for 
attending college, college choice/application behaviors, high school characteristics, high school 
achievement, and social-economic status are well represented. Environmental elements such as 
students’ extra curricular activities, employment when enrolled, job related training/courses, 
institutional characteristics, financial aid information, and tuition/expense information are also well 
represented. Students’ college achievement, views on social issues, volunteer work, aspirations, 
and success in transition to work/graduate school are described in detail. 

With regard to limitations, the data set does not provide information on teaching/leaming 
styles or processes. No information is available about students’ individual activities in college, 
students’ contact or interaction with faculty or student services, students’ psycho-social 
development, civic behavior after college, or college satisfaction. 

National Education Longitudinal Study of 1988 (NELS) 

The NELS has a data structure similar to the NLS-72 and HS&B. Although the third 
follow-up provides information on postsecondary education of students two years after high 
school graduation, the strongest aspect of the data set thus far is its attention to the experiences of 
high school students. From a design standpoint, a strength of NELS is that it includes a non- 
college going sample and that there are several waves of follow-up data, including possibly one 
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more wave after college completion. High school transcripts are available and college transcript 
supplements are planned. 

The NELS is well represented in high school educational activities, including individual 
academic and social endeavors, and organized curricular, extra-curricular activities as well as high 
school climate, work activity during high school, and anti-social behavior. The NELS is also 
strong in terms of pre-college goals and values, with excellent representation in attitudes/values, 
self-esteem, reasons for attending college, educational/career aspirations, and college 
choice/application behaviors. There is adequate information about the respondents high school 
characteristics, including grading system information, location, and climate as well as teachers and 
administrators' responses about the school. In addition, the NELS administered its own 
standardized test in 8th grade, and includes results from that test, in addition to college entry 
standardized tests, high school grades, and high school tracks. 

The NELS is extremely strong in terms of personal and family background information, 
such as English proficiency, information on respondents’ drug abuse, and measures of 
socioeconomic status. Of particular note are measures relating to family relations and parental 
involvement in child's upbringing and education. However, the NELS has only limited 
information on disabilities and religious background. 

With respect to college endeavors, individual (academic and social) and organized 
(curricular and extra-curricular) activities are well represented. Only co-curricular activities are of 
limited representation. Similar to the BPS, the NELS data set is particularly strong in terms of 
information related to employment, including employment while enrolled, employment while not 
enrolled, and job training and/or courses. 

The NELS is weak in terms of interaction with faculty (limited representation) and student 
services (no representation). It also has only limited representation in terms of institutional 
characteristics, but is slightly better represented in relation to the respondents’ impressions of their 
institutions. In addition, the NELS contains no information on teaching or learning processes. 
Enrollment and financial aid information is well documented in the NELS; however, only limited 



Review of national data resources 

Page 20 



information is available regarding tuition and related expenses. Financial aid information includes 
information on parents' activities in relationship to the respondents’ financial aid status. 

The NELS is extremely weak in relationship to variables related to cognitive outcomes such 
as college achievement. There is no information on constructs such as college grades, grade point 
averages, or honors received. In contrast, the NELS is well represented in terms of the 
respondents’ psychosocial development and views on social issues. While only limited information 
is available on political or voting behaviors, information on volunteer work is well represented. 

Future occupational and educational aspirations are well represented, and the NELS has 
many constructs measuring success in transition to work. However, special caution should be 
taken as these variables measure success in transition to work from high school. Satisfaction 
outcomes relate to work-related satisfaction only. 

National Longitudinal Study of the High School Class of 1972 (NLS-72) 

The NLS-72 has the longest time span of sixteen years among the student data sets being 
reviewed. Data collection started in 1972 with 12th grade students. As with other longitudinal data 
sets sponsored by NCES, a strength in the design of the NLS-72 is that it includes a non-college 
going sample and that there are several waves of follow-up data. High school and college transcript 

data are available. 

The information on educational activities in high school is limited, but the NLS-72 does 
have good representation on curricular activities. The NLS-72 is strong in terms of the 
respondents’ pre-college goals and values; it has good representation on variables relating to 
attitudes/values, self-esteem, educational/career aspirations, reasons for attending college, and 
college choice or application behaviors. It also has representative information on high school 

characteristics and high school achievement. 

Information on personal and family characteristics is limited for English proficiency, 
respondent's disabilities, and religion. However, a wealth of information on measures of SES is 
available, and NLS has good representation on parental involvement in the children s upbringing 
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and education as well as on financial assets and liabilities. Constmcts related to teaching and 
learning in college are not represented. 

In terms of college activities, the NLS has limited representation on academic, curricular, 
and extra-curricular, and no representation on social and co-curricular activities. One of the 
strengths of the NLS is that variables relating to employment information and job training are well 
represented. However, the NLS has no representation on faculty contact and interaction with 
student services. Institutional characteristics, impression of college, and information on enrollment 
and financial aid are well represented. 

Student outcomes constitute another aspect of strengths of the NLS. It has good 
representation across all outcome categories, such as college achievement, psychosocial 
development, values and goals, political behaviors, volunteer work, aspiration, success in 
transition to work/graduate school, retention, and college satisfaction. 



National Postsecondary Student Aid Study (NPSAS) 

This data set is mainly concerned with students’ financial information when they enrolled in 
college. As such, NPSAS has detailed information on students’ or student families’ financial assets 
liabilities, financial aid status, and tuition/expense. Students’ high school achievement, curricular 
activities in college, employment when they were enrolled, interaction with student services, 
enrollment information, college achievement, views on social issues, aspirations after college, 
success in transition to work/graduate school, and satisfaction with college education are well 
represented. 

The data set contains no information on teaching/leaming styles or processes. Students’ 
educational activities before college, family relations, religion, individual activities in college, 
faculty contact or interaction, impression of college, psycho-social development, political behavior 
after college are not represented, either. 
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Recent College Graduates Study (RCG 1991) 

The RCG is a cross-sectional study (and has been replaced by the Baccalaureate and 
Beyond study). As such, the application of the Input-Environment-Outcome model to this data set 

is limited. Information from college transcripts is available. 

In a strict sense, variables relating to inputs, such as educational activities, and goals and 
values, are not available. The RCG contains limited information about the respondents’ measures 
of SES and demographic characteristics. The RCG has good representation on work-related 
information, job-related training or courses, financial aid and college expenses. However, all other 
sub-categories in the environment section have no representation. 

In terms of outcomes, the RCG only contains well represented information on success in 
transition to work/graduate school. There is no representation on all other outcome categories. 

Strengths and Limitations of Individual Faculty Data Sets 

Higher Education Research Institute Faculty Surveys (HERI-89; HERI-92) 

The HERI faculty data sets have a cross-sectional survey design. The data sets can be 
considered as parallel studies to the CIRP because of the similarity of questions. The strongest 
aspect of the 1989 and 1992 HERI faculty data pertains to information relating to teaching methods 
used. A weak aspect of the data relates to a lack of information about the professional teaching 

associations to which the faculty member belongs. 

The HERI faculty data is adequately represented in terms of time spent on teaching, types 
of classes taught, satisfaction with environment/climate, and views on social issues. Of the 
variables related to teaching and learning, the HERI faculty data has only limited representation in 
terms of intended learning outcomes for students, time spent on service activities, a general student 
orientation, advising and/or mentoring roles, teaching awards incentives, professional 
development, and demonstration of racial or cultural awareness in both teaching and research 



arenas. 
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American Council on Education Faculty Survey of 1972 

Similar to the HERI Faculty data, the ACE Faculty data set of 1972 is represented in terms 
of time spent on teaching, types of classes taught, and satisfaction with environment/climate. In 
contrast, it has more information on faculty members’ intended learning outcomes for students. 
However, there is no representation on professional teaching associations or professional 
development, racial or cultural awareness in teaching or research activities, and views on social 

issues. 

National Study of Postsecondary Faculty (NSOPF) 

The NSOPF is a cross-sectional study of postsecondary faculty members, which was 
conducted in 1988 and 1993. NSOPF-88 and NSOPF-93 are very similar in terms of 
representation on each thematic category of interest. Only one exception lies in information on 
teaching methods used. While NSOPF-93 has good representation on the category, NSOPF-88 
has no information on it. The NSOPF data sets are adequately represented in other categories, such 
as time spent on teaching and types of classes taught. However, the NSOPF data sets have limited 
representation on time spent on advising/mentoring and time spent on teaching committees as well 
as some generally student-oriented questions. 

Results Across Student Data Sets 

Inputs 

While many of the data sets include information about high school educational activities 
(e.g. academic, social, curricular, co-curricular, extra-curricular, and other activities), the BPS, 
NPSAS, and RCG by-and-large do not contain such information. These data sets, however, tend 
to be cross-sectional in design and have samples that are either composed entirely of postsecondary 
students (NPSAS) or of students who have finished their postsecondary degree work (RCG). 
B&B, CIRP 1971-80, CIRP 1985-89, and NLS-72 are weaker with respect to high school 
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educational activities than CIRP 1986-90, CIRP 1987-91, HS&B, and NELS. Overall, it is the 
NELS data set which has the most abundant data relating to high school educational activities. 

The pre-college goals and values of the respondents (attitudes/values, self-esteem, 
educational/career aspirations, reasons for attending college, college choice/application behaviors) 
are well-documented in a majority of the data sets. Exceptions to this include CIRP which lacks 
detailed questions regarding the college search process and RCG which has only one question 
about this precollege educational/career aspirations. Further, although B&B and NPSAS provide 
good information regarding college choice and application behaviors, these data sets are weak with 

respect to all other pre-college goals and values information. 

Information regarding the characteristics of the respondents high school is generally 
limited. HS&B is the only data set that is well represented in this area, although NELS and NLS- 
72 do provide several questions on this issue. However, no questions about high school 
characteristics are included in BPS, NPSAS, or RCG. It is also interesting to note that some data 
sets provide information about the specific skill capabilities of the respondents (CIRP 1987-91) 
and other data sets include standardized test results (NELS). While high school achievement is well 
documented in many of the data sets, BPS, CIRP 1971-80, and CIRP 1985-89 have Just limited 
representation. Further, BPS does not include information about the respondents high school 
grade point average. 

Detailed personal information about the respondents is not included in many of the data 
sets. For example, information regarding English proficiency and drug use is scarce. While a few 
questions about the respondents’ English proficiency are included in data sets such as B&B, CIRP 
1987-91, HS&B, NLS-72, it is the NELS data set which is particularly well represented with 
questions regarding the respondents’ English proficiency levels. NELS also provides abundant 
information about the respondents’ use of drugs. In addition, information regarding the physical 
disabilities of the respondents is available in many of the data sets. However, CIRP 1971-80, 
CIRP 1985-89, and RCG do not contain this information. 
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Only HS&B and NELS offer information about family relations, yet four of the data sets 
include questions about parental involvement in students’ upbringing and education - B&B, 

HS&B, NELS, and NLS-72. The CIRP 1986-90 and CIRP 1987-91 which provide more 
information about the respondents’ religious affiliations than the other data sets. However, CIRP 
1971-80, CIRP 1985-89, HS&B, NELS, and NLS-72, also contain some questions relating to 
religion. All of the data sets except CIRP 1971-80, CIRP 1985-89, and RCG include questions 
about the respondents’ financial assets/ liabilities although B&B, BPS, and NPSAS are the most 

represented in this area. 

Teaching/Learning 

None of the data sets document teaching or learning processes as defined by the parameters 
of our study (see Table 1), with the possible exception of the CIRP 1985-89, which asks the 
student respondents to indicate his/her frequency of experience with different types of 
examinations or class assignments. However, a few data sets include broader questions relating to 
the respondents’ overall satisfaction with or evaluation of their instruction or learning development 
(BPS, CIRP). While these data sets may be limited in terms of specific variables related to teaching 
or learning processes, they can be used to assess student outcomes through key input and 
environment constructs, many of which are strongly represented in the individual data sets. 

Environments 

While individual college activities (academic, social) and organized college activities 
(curricular, co-curricular, and extra-curricular) are included in many of the data sets, RCG is the 
only data set that does not have any college activities represented. The majority of questions 
pertaining to individual and organized college activities are contained in B&B, all versions of the 
CIRP except 1971-80, and NELS. In contrast, HS&B and NPSAS lack information about the 
respondents’ academic activities. Social activities have at least some representation in all of the data 
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sets except HS&B, NLS-72, NPSAS, and RCG, and co-curricular activities have at least some 
representation in all of the data sets except B&B, NLS-72, NPSAS, and RCG. 

Every data set includes employment information about the respondents during college. 
However, only BPS, NELS, NLS-72, and RCG provide any information regarding the 
respondents’ employment while not in college. It is important to note, however, that the NELS, 
NLS-72, and HS&B include a non-college going sample. Other college activities documented in 
the data sets include job-related training (excluding CIRP versions and NPSAS), faculty contact 
and interaction (B&B, BPS, CIRP versions), interactions with student services (B&B, BPS, 

CIRP versions, NELS, NPSAS), and other related activities (all versions of CIRP except 1987- 
91, NLS-72). Institutional characteristics are not only included but are particularly well represented 
in most of the data sets. However, the respondents’ impression of college (an institutional 

construct) is not contained in the B&B, NPSAS, or RCG. 

All data sets have a strong showing of enrollment and financial aid information other than 
RCG which lacks enrollment data. In particular, NPSAS has abundant information about the 
respondents’ financial aid, including the sources of financial aid and the reasons, if any, why the 
respondent did not apply for financial assistance. Some interesting financial aid information is also 
available from BPS: reasons why the respondent did not apply for financial aid; parent’s activities 
in relationship to the respondents’ financial aid status; and the financial indebtedness of the 
respondents. NELS has information on the parents' activities in relationship to the respondents' 
financial aid status as well. However, while most data sets document the respondent’s tuition and 
expenses, NLS-72 and CIRP do not. 



Outcomes 

Many of the data sets are well represented with regard to cognitive and psychosocial 
outcomes. However, cognitive outcomes are not included in RCG or NELS and psychosocial 
outcomes are not represented in either RCG or BPS. Specific information about the respondent s 
views on social issues is contained in all data sets except BPS and RCG. In addition, BPS and 
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NLS-72 provide the most abundant information about the respondents’ political behaviors and 
volunteer work and NELS, CIRP 1987-91, and NPSAS also contain some questions about the 

respondents’ civic behaviors. 

Finally, most data sets are well represented with regard to aspirations (excluding RCG) and 
success in the transition from college to work/graduate school (excluding CIRP 1985-89 through 
1987-91). Again, it should be noted that some data sets which are cross-sectional (e.g. NPSAS) 
do not have information about post-college activities, and some longitudinal data sets have not yet 
collected data on students after their graduation, such as the NELS:88. Questions relating to the 
retention of students in college and to college satisfaction are well represented in BPS, CIRP, and 
NLS-72. College satisfaction is also well represented in NPSAS. 



Results Across Faculty Data Sets 

Some of the faculty data sets included in this study (HERI:89, HERI:92, ACE) contain at 
least a few questions relating to goals faculty members have for their students. However, with the 
exception of NSOPF-88, abundant information is available regarding the types of teaching 
methods used by faculty. Specifically, the HERI data sets contain the largest number of questions 
relating to teaching methods, but NSOPF-93 and ACE also provide a limited amount of 
information (e.g. ACE asks whether or not faculty work with a teaching assistant). Information 
about service functions performed by faculty varies from one data set to another, with NSOPF-88 
and NSOPF-93 focusing on teaching committee loads while HERI and ACE rely on time-spent-on- 

task-information. 

The extent to which faculty are student-oriented is measured to a limited degree in all five 
data sets. Further, there is a good amount of information about the amount of time faculty spend 
teaching and the types of classes which they teach. A limited number of questions also address the 
amount of time faculty invest in student advising and mentoring. However, although teaching 
awards and incentives are included in the HERI and ACE data sets, no professional teaching 



association information is represented in any of the surveys. 
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Both of the HERI data sets contain information regarding attendance at racial/cultural 
training workshops as well as indications of cultural awareness and sensitivity. HERI data sets 
also include good representation of faculty views on social issues, a topic that the other data sets do 
not examine. However, faculty satisfaction with the environment or climate of the institution is 
documented in each of the data sets. Finally, it is important to note that while the NSOPF data sets 
cannot be readily merged with other student data sets at the level of the institution, the HERI:89, 
HERI:92, and ACE data sets can be merged in this manner. By allowing for comparisons across 
student and faculty surveys when merged together, researchers can investigate a broader range of 
teaching and learning issues and outcomes than are possible using a single data base. Although it 
would be preferable to be able to link students and faculty together in ways that are possible in 
studies like High School and Beyond, institutional-level merges can at least provide some basic 
information on institutional context. 

Limitations of the Data Sets Cited in Empirical Studies 

In addition to our analyses of the federal data sets, we also undertook a review of literature 
related to limitations of the data sets cited in published empirical studies. Our selection and 
analysis process began by identifying all empirical research studies utilizing any of the student, 
faculty, or institutional level data sets that we identified for this project. Materials such as technical 
reports and manuals were not included in this phase of the project since they were consulted for the 

data set analyses. 

Keyword searches were conducted using the ERIC (Educational Resources Information 
Center) database. The full names and acronyms of the data sets were used in keyword searches 
from the year 1982 forward, with the exception of the ACE Faculty Survey of 1972, which was 
searched from the year 1966 forward. The list of studies found were divided among the research 
team and each team member scanned the works for any limitations cited in the text pertaining to the 
data set itself, and not to other facets of the research or study. The research team then constructed 
broad categories — survey design, survey sampling, measurement, index or scale, and “other - 
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based upon the predominant themes uncovered by the review process. Each team member 
organized the limitations of the data sets that they discovered in the literature review into these 
categories and relevant subgroupings. Later, these categorizations were cross-checked by another 
team member. Discrepancies were mutually discussed and revisions were made when necessary. 

All of the limitations were organized into an appendix (see Appendix A) and then summarized in a 
matrix based upon the general categories. These are shown in Table 6. 

The limitations cited in the following section of this report are reflective of comments found 
in published research studies. These studies were typically found in educational, economic, 
sociological and social psychological journals as well as in conference proceedings, and 
published/unpublished reports. Generally speaking, most of the authors cited issues concerning 
sampling representation, and a lack of constnicts or variables appropriate to their research inquiry. 

The most popularly utilized— and thus critiqued-data sets in the empirical literature were 
(in rank order) the High School and Beyond Survey (HS&B), Cooperative Institutional Research 
Project (CIRP), National Postsecondary Student Aid Study (NPSAS), National Longitudinal 
Study of the High School Class of 1972 (NLS-72), and the National Education Longitudinal Study 
of 1988 (NELS). For the HS&B, several of the authors indicated that the data set was in need of 
more variables or more in-depth coverage with regard to: the respondent’s cultural background, 
financial aid information, and measures related to achievement, income, educational or 
occupational aspirations after college graduation, and types or levels of graduate schools attended. 
Other limitations cited for the HS&B included a high individual item non-response bias and 

questions about the representativeness of the sample. 

Similarly, comments about the CIRP tended to focus on representation (mainly an issue of 
low response rates), variable availability, and the depth of categories. Several authors suggested 
that more in-depth survey information was needed with regard to the following topics: college 
choice, quality of effort, intensity of faculty-student interaction, work values or job characteristics, 
affective measures, voluntary or involuntary withdrawal, and home environment characteristics. 
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While the overwhelming majority of limitations cited for the NPSAS involved 
representation issues, limitations of the NLS-72 cited in the literature were spread out across 
several categories. Questions pertaining to the NLS-72 included issues such as: the length of the 
survey, the reliability of its measures, sampling errors, and individual item non-response. Finally, 
since the NELS data set is still collecting information through what would be the respondents 
postsecondary years, many of the limitations of the NELS cited by authors has related to a lack of 
national representation in terms of parent and secondary school teacher responses. 

Fewer empirical studies have been conducted which focus on faculty and institutional data 
sets. Several authors have expressed the wish that the Higher Education Research Institute 
(HERI) Faculty Survey and the National Study of Postsecondary Faculty (NSOPF) were 
longitudinal instead of cross-sectional in order to better reveal causal relationships and the 
emergence of patterns over time. In addition, one author suggested that the NSOPF should contain 
information about how faculty members perceive the expectations of their institutions concerning 
their workload, and another author recommended that the HERI Faculty Survey include more 
information about the background and historical legacy of the institutions in which the faculty 

members worked. 



Concluding Observations 

The purpose of this analysis was to review existing national data sets to determine their 
utility in studying teaching, learning, and assessment activities. In doing so, our intent is to 
provide guidance to those interested in using one or more of the existing data sets for research and 
policy development purposes, but also to help strengthen future research on these topics by 
identifying areas where new data collections could make strong contributions to our knowledge 

base. 

The results presented above demonstrate that our existing national data resources can be 
described as having a variety of strengths and limitations when viewed from the perspective of 
those engaged in studying teaching, learning, and assessment. It is possible to view these results 
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and, by emphasizing the limitations, see a glass that is half empty. Given the practical and 
theoretical complexity of studying teaching, learning, and assessment in postsecondary education, 
our view is that a balanced consideration of these findings produces the image of a glass that is half 
full; even though there is much room for improvement, the existing data resources provide many 
opportunities to add to our knowledge about certain aspects of teaching, learning, and assessment. 

Given the appropriate resources, plans, and designs, all of the data sets we reviewed could 
be improved. For example, the response rates of some of the data sets - especially the CIRP 
surveys - could be improved dramatically, and the longitudinal span of all the data collection 
schedules could be extended. All of the data sets could contain a wider array of measures on 
attitudinal, cognitive, and employment outcomes, and these kinds measures could also be 
improved from a technical standpoint in terms of validity and reliability. In addition, the data sets 
could be consistently supplemented with unobtrusive and archival data provided by college 
transcripts and employment records. These kinds of improvements might be excellent priorities for 
improving current data collection systems, but it is not clear that such investments would yield 
more than incremental improvements in our knowledge about teaching, learning, and assessment. 
(This is not to say that such investments should not be made; the data sets reviewed have multiple 
uses and modest investments in critical areas may well yield tremendous benefits for purposes 
other than studying teaching, learning, and assessment issues.) 

It should be noted that our review specifically focused on national data bases that were 
generated primarily through survey approaches, since these are the kinds of data most generally 
available for secondary data analysis. Survey research has tremendous value in helping provide 
data on many important aspects of postsecondary education, but it may be that the approaches used 
to generate the data we reviewed are not ideally suited to studying teaching, learning, and 
assessment issues. For example, each of the student data sets we reviewed had a good deal of 
strength in terms of selected outcomes represented in the data, but there was tremendous variability 
in the measures available to study how teaching and learning processes might contribute to such 
outcomes. Outcome measures are very important, of course, but process indicators are likely key 
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elements to understanding the rich complexity of how students, faculty, and institutional contexts 
interrelate when fostering learning within postsecondary education. 

Survey approaches that allow linkages between student respondents and their peers, their 
families, and the faculty who teach them might be useful additions to current survey approaches to 
collecting quantitative data. Such strategies have been used successfully in collecting data in 
elementary and secondary settings, but are not well represented in national data resources at the 
postsecondary level. The paths that students take when moving through the postsecondary system 
are obviously more varied and complex than those that exist in pre-postsecondary systems, but the 
ability to link students with people and settings that may influence their development would be a 
welcome addition. Non-survey approaches can also make strong contributions - and possibly 
stronger contributions - to our knowledge about these topics, while also informing subsequent 
survey data collection efforts. Ethnographic and other qualitative approaches, as well as 
technology-facilitated data collection efforts such as those provided through video and audio 
recordings of classroom interactions, should all be considered as useful additions to the data 
provided by national surveys. 

An expanded emphasis on the changing role of faculty and staff in the development of 
postsecondary students should also be considered. The current approaches to collecting data are 
useful in portraying global trends in the activities of these personnel, but the lack of longitudinal 
data makes it difficult to understand how faculty and staff can best develop in their ability to serve 
changing student needs. This, coupled with an ability to link faculty and staff data with the 
students with whom they interact, would add a tremendous amount to our knowledge about the 
effectiveness of faculty and staff in facilitating student development. 

In considering directions for future data collection efforts, the results of this review do in 
fact underscore the observation that "national surveys presently tell us relatively little about what 
actually takes place at the classroom level" (National Center for Education Statistics, 1996, p. 16). 
There are many possible paths that can be taken to rectify this limitation -- from large-scale 
longitudinal data collection efforts that track the development and experiences of postsecondary 
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students (and their professors, families, and employers) to more intensive cases analyses of 
teaching, learning, and assessment in a small number of classrooms or campuses. Each of these 
alternative paths necessarily involve design and resources trade-offs, and given the diversity of 
postsecondary settings, it is likely that there is no "one best path" to take in rectifying the current 
limitations in existing data sets. Instead, a multitude of approaches may be the most useful. 
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Table 1 . . . ^ 

Definitions of terms used in reviewing student data sets 



INPUT 



Educational activities: Individual 



Academic: Constructs related to academically-oriented activities undertaken by students during high 
school on an individual level that are not formally organized by the school. Me^ures reflect the 
respondent’s level of involvement with the high school curricular program and how often a variety 
of instructional approaches are integrated into the learning process. Such constructs include use of 
calculators, note taking skills, activities such as time spent studying or doing homework, library 



usage patterns, etc. 

Social: Constructs related to socially-oriented activities undertaken by students during high school 
on an individual level that are not formally organized by the school. Such constructs include 
activities such as socializing with friends, reading for pleasure, etc. 



Educational activities: organized 

Curricular- Activities undertaken by students during high school related to academic pursuits which 
are sponsored by the school. Such constructs include questions related to choice of courses, type 
of program in which enrolled, etc. 

Co-curricular : Activities undertaken by student during high with an academic focus that are not part 
of the school’s curriculum, which are sponsored by the school. Such constructs include 
participation in academic honor societies, etc. 

F.xtra-curricular : Activities undertaken by students during high school outside of curricular or co- 
curricular pursuits which are formally organized or sanctioned by the school. Such constructs 
include participation in athletics, student government, or other types of student clubs or 
organizations. 

Educational activities: others 

Vocational training or courses : Activities or courses taken by students during high school directly 
related to vocational or job skills or interests. Such activities include course taking patterns in 
relation to vocational work or job training experiences during high school. 

Teacher contact/interaction : Respondent’s interaction with high school teachers, either in formal or 
informal circumstances, outside of the classroom. Examples may range from meeting teachers 
during office hours to visiting teachers at their homes. 

Educational climate : Constructs used to measure the perceptions and attitudes of the respondent 
with regard to patterns of organizational life in the high school 
(e.g. other students often disrupt class, students get along well with 
teachers, there is a real school spirit). 

Work activity during high school : Work activity during HS: Any type of employment performed 
while the respondent was enrolled as a high school student. This includes hours per week spent on 
most recent job, lowest hourly wage accepted while in HS, 
amount of time spent looking for work, etc. 
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Others: Any other types of activities that the respondent engaged in during high school that does 
not fit any of the above categories. Variables include: drank beer, got arrested, watched television, 

etc. 

Goals/values 

Attinides/values: Perceptions of the respondent which are reflective of personal ideology and larger 
social values/outlooks, (e.g. whom they admire, want to make a lot of money). 

■Self-esteem : Measures which reflect the respondent’s belief in self , or general level of self-respect 
(e.g. academic ability, self-rated popularity, self-confidence) 

Asnirations: Plans or expectations for future schooling or job placement which are generally 
considered desirable or important to the respondent or significant others in the respondent s 
environment. Variables in this category include student’s probably career, highest degree planned, 

etc. 

Reasons for attending college : Reasons for attending college: Measures which reflect the 
motivations and values of the respondent as well as influences by family and significant 
others regarding educational attainment. Statements explain why respondent decided to go to on to 
higher education (e.g. development of work skills, intellectual growth, quality of instruction, 
social life, prestige of school). 

College rhnire/annli cation behaviors: Measures which reflect the decision-making criteria of high 
school applicants to college. Variables in this category include both the number of colleges to 
which the respondent has applied for admission and the method of selection (e.g. advice of a 
friend, grads get top Jobs). 

High school nharacteristics : Self-reported information regarding the high school attended by the 
respondent. Variables include grading criteria, institutional type, location and ranking identifiers of 
the respondent’s high school (e.g., city/state, public/private, region of country, size of student 
body, etc.). 

Hiph school achievement: Academically related achievement attained by R (student) during high 
school, including constructs such as grades, grade point averages, standardized test scores, 
academic honors, and diploma attainment. 

Personal 

F.nplish proficiency . The extent to which the respondent self-reports competency in the 
understanding and use of the spoken/written English language. Variables in this category include: 
how well respondent understands English when spoken by others, how well respondent can read 
English, etc. 

Information on respondent’s drug use : Variables that reflect R’s use of cigarettes, alcohol, 
marijuana, and other controlled substances. 

Information on respondent’s disabilities : Information on respondent's disabilities: Any type of 
personal handicap (physical or mental) reported by the respondent. Variables in this category 
include: deafness, orthopedic handicap, speech disability, specific learning disabilities, etc. 
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Family 

Mpasiires of gorineconomic status : Measures which reflect the level of education, occupation, 
household income, and household amenities attained by the parents/family of the respondent (e.g. 
does respondent have a computer, how far in school did respondent’s father go, does family 
receive a newspaper, etc.) 

Familv relations- Self-rated measures of compatibility and empathy with family members and 
Uriables which reflect the status of the health and welfare of the family unit. Variables in this 
category include: respondent gets along with family members, family member has been ill in the 

last two years, etc. 

Parental involvement in child’s upbringing and education : Personal involvement in child's 
upbringing and education: The extent of parental support, supervision, and discipline which the 
respondent receives in the home environment (e.g. how often parent checks respondent s 
homework, parents limit television watching, awareness of student 
activities and grades, level of communication with parents). 

Relieion- The organized religion, if any, to which the respondent belongs as well as level of 
involvement in practicing that religion (e.g. what is religious background of respondent, how often 
does respondent attend religious services). 

Financial and liabilities : Measures which reflect the fiscal interdependence of the 
respondent’s family unit (e.g. loans, mortgages, investments, etc.) 



TEACHING & LEARNING 

Variables related to teaching stvles/processes : Related to R's (students') descriptions, reactions, 
impressions, and/or evaluations of their college instructors teaching styles, methods, or 
processes. Teaching styles, methods, or processes may include both the type of instructional 
delivery (e.g., lecture, discussion, lab, etc.) and types of assignments or projects (e.g., 
collaborative or group work, role plays, etc.). 

Variables related to learning stvles/processes : Related to self-reported descriptions, reflections, 
and/or evaluations of R's learning styles or processes. Variables in this category include both 
learning styles, such as dimensions in the Kolb learning style model or gender-based style 
differences like the Belenky et al. theory, as well as learning processes, such as studying 
techniques or approaches to learning. 



ENVIRONMENTS 

College activities: individual 

Academic : Constructs related to academically-oriented activities undertaken by students during 
college on an individual level that are not formally organized by the institution. Such constructs 
include activities such as time spent studying, library usage patterns, etc. 

Social : Constructs related to socially-oriented activities undertaken by students during college on an 
individual level that are not formally organized by the institution. Such constructs include activities 
such as socializing with friends, reading for pleasure, etc. 
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College activities: organized 
taking patterns, etc. 

ylllon" ta^aSe perfo?ming research with a faculty meruber, etc. 

SfF^Sc"n1.S: " 8-err.mer.r. or other types of 

Student clubs or organizations. 

College activities: work related 

I r,-m- i" PSI: Any variables related to R’s employment 

roles Can also be related to combination employment/enrollment patterns. 

scg.'sa?aa gBg 

R’s wLe tracked from their adolescence, there were members of the s^ple who vvent straight into 
the work force and did not attend a postsecondary institution. All variables related to their w 

status were placed in this category.) 

College activities: others 

T«K traininp/courses: Activities or courses taken by students dunng college directly rdated 

to vacations or jolrel^ skills or interests. Such activities include course taking Pa terns " 
relation to licensmg or certification in a certain vocation, or job-related field-work, internships, or 

co-ops. 

mntart/interaction: R's (students’) interaction with faculty, either in formal or informd 
circumstances, outside oTthe classroom. Examples may range from visiting faculty member uring 
their office hours to having dinner at a professor's home. 

Tntprartion with .mde.nt services: R’s (students’) usage of, perceptions of, and/or satisfaction wit_h_ 
sldent services atthemshtution. Examples of student 

services (e.g., personal-psychological, career, and/or academic), recreational facilities, etc. 

Others : Any other types of activity R (student) engaged in during college that does not fit any of the 

above categories. 

Institutional 

Characteristics : Stmctural characteristics of higher education insU^ ^ research L 

attending. May include such characteristics as level (e.g., 2- or 4-year), type ^earc 
liberal arts); control (public, private or proprietary); region of country; enrollment size, . 
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Tmnrp^^inn of college : R's (students') descriptions, comments, reactions and/or evaluations of 
their college environment, ranging from a general impression (e.g., evaluation of overall quality of 
institution) to assessments of specific portions of the environment (e.g., satisfaction with residence 
environment). 

Enrollment 

F.nrollment information: Constructs related to the type of enrollment, enrollment patterns, and/or 
degree program of R (student) that is not related to a specific curricular program or major. 
Examples include variables related to part- or full-time enrollment, enrollment status by month or 
year, or enrollment in a degree program, such as an associates degree. 

Financial aid information : Information related to R's (students') financing of their 
postsecondary education, including any or all of the following: work-study, loans, grants, 
scholarships, fellowships, assistantships, other forms of employment, and parental/significant 
other assistance. 

Tuition/expenses information : Information related to R's (students ) expenses related to tuition, 
room, board, and other expenses related to the pursuit of their postsecondary education, such as 
books, necessary equipment, commuting expenses, etc. 



OUTCOMES 

Cognitive 

Cnllfigfi achievement : Academically related achievement attained by R (student) during college, 
including constructs such as grades, grade point averages, academic honors, and degrees attained. 

Psychosocial 

R's psychosocial development : Variables which reflect respondents' personal growth, including 
self-understanding and the ability to both understand and get along with others. These self-rated 
abilities can be used to measure the social, emotional, and psychological growth of the respondent. 
Variables include perceptions of academic, artistic, physical, and social abilities or self-confidence. 



R's views on social issues (values, goals) : Opinions, attitudes, and/or views of R (student) 
pertaining to personal or social values or goals. Such values or goals may be directly related to R, 
such as R's plans for the future, or they may be more concerned with broader social issues, such 
as promoting racial diversity or protecting the environment. 

Civic Behaviors 

Political behaviors : Activities undertaken by R (student) of a civic or political nature, such as 
registering to vote, actually voting, participating in a political campaign, serving on local governing 
boards, or running for election. 

Volunteer work : Any type of activity performed without pay in service to a local or broader social 
concern. These activities may include working for a local hospital or clinic, volunteering at various 
shelters, or assisting with youth organizations. 
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Aspirations 

Asnirations: Future educational, career, or personal goals or plans of R (student).^an include such 
^p^rations'as graduate school plans, certain career goals or attainment, or family/mamage 
considerations. 

giirrpg g in transition to work/graduate school : Variables related to the transition from 
college/postsecondary education to working or further educational roles. Possible constmcts in this 
cSry include: choice of graduate school, graduate major, present occupation, present 
occupational salary, etc. 

Retention 

Measures of the educational success of the respondent relating to persistence and continued 
enrollment in college. Variables in this construct would include re-enrollment in college, degree 
completion, reasons for dropping out, etc. 

Satisfaction 

Variables in this category include the degree and manner in which the respondent expenenced 
pleasure or gratification with educational experiences dunng college. Variables in this category 
fnclude: satfsfaction with campus climate, satisfaction with quality of instruction, work, courses, 
extra curricular activities, student services, social life, etc. 
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Table 2 ^ 

Definitions of terms used in reviewing faculty data se^ 



Intended learning outcomes 



Questions relating to faculty members' planned or desired outcomes for students who enrolled m 
£r co"^. Examples may include whether or not the instmetor « as a goal for h.sdier students 
that they become better writers or more advanced in a particular skill, etc. 



Information on teaching methods used 



Questions relating to the instructional style or technique used by the facuUy member while teaching 
a course Examples may include using the lecture method, the semmar/discussion method, or ot r 
techniques like collaborative work groups, simulations or role plays, etc. 

Information on technology used in teaching practices 

Questions relating to faculty members' use of technology for instructional purposes. 
multi-media or related computer usage, audio or visual equipment, and/or scientific or laboratory 

equipment. 

Se rvice variables ^ 

Questions relating to the type and amount of activity faculty members i^rform in se^ice to their 
institution outside of their normal teaching-, research-, and/or appointed administratively related 
duties. Examples may include serving on academic committees, task forces, and campus group 
boards, or being involved with student groups/activities, etc. 



Student oriented 



Questions attempting to ascertain the relative amount of importance, significance, and/or 
rcsDonsibility the faculty member places upon activities in relation to students, (as opposed to their 
research, service, administrative roles, etc.). Examples may include Likert-scale questions about 
the importance of being available to students at all times, etc. 



Time spent teaching 

Questions relating the amount of time faculty members reported they spent on teaching activities, 
which can include classroom time, class preparation, grading, and cumculum revision. 



Typ es of classes taught 

Questions relating to the discipline, subject matter, and/or level (e.g., lower or upper division, 
undergraduate or graduate) of courses that the faculty member teaches. 



Advising/mentoring 



Questions relating to the type and amount of advising and/or mentoring (activities with students 
that assist or help support students' academic or emotional development) the faculty member 
engages in, including both undergraduates and graduate students. 
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n r«>lating to the number or types of professional teaching associations or organizations to 

SSr S"y member belongs. TOs category does not include membership m other, more 
discipline- or research-specific associations or organizations. 




Questions relating to the amount or types of activities the faculty member is enga^n^as engaged 
?n for the pS greater sensitivity to students of diverse backgrounds. In addition, this 
category may^ also include questions posed to the faculty about their own cultural 

awareness/sensitivity. 




Questions relating to faculty members' assessments, perceptions, and/or evaluations of their 
StioL' env"^^ or campus climate. Examples may include general assessments of the 

quality of the student body or may be more specific, such as the quality of the equipment the 
faculty member uses. 



Questions relating to faculty members' opinions or judgments on relevant and 

issues both in the broad societal sense and more localized to campus considerations 

may include views on capital punishment and opinions about their campuses speech codes. 
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Anoendix A 



Limitations of Data Sets Cited in Empirical Studies 



1. Student data sets 



BPS 



Fitzgerald, Kobert, And Uthers. (iyy4.) 
Descriptive Summary of 1989-90 
Beginning Postsecondary Students: 
Two Years Later. Contractor Report. 
Statistical Analysis Report. U.S. 
Government Printing Office, 
Superintendent of Documents, Mail 
Stop: SSOP, Washington, DC 20402- 
9328. 


"EDJ7269F 


BPS includes only first time enrollees in 
any post-secondary education (which 
means students who attended a vocational 
school earlier would not be counted, as 
well as those who had previously been 
enrolled in a college or university). Only 
fiill time students were included. 


CIRP 


Antonio, Anthony Lising. Making 
Social Comparisons: Black and \^ite 
Peer Group Influence in College. 
ASHE Aimual Meeting Paper. Paper 
presented at the Aimual Meeting of the 
Association for the Study of Higher 
Education (20th, Orlando, FL, 
November 2-5, 1995). 


ED391412 


These limitations suggest that smaller 
scale, intra-institutional studies are 
probably necessary to uncover many of 
the issues brought up in this study. 


Arredondo, Mansol. (1995.) Faculty- 
Student Interaction: Uncovering the 
Types of Interactions That Raise 
Undergraduate Degree Aspirations. 
ASHE Aimual Meeting Paper. Paper 
presented at the Annual Meeting of the 
Association for the Study of Higher 
Education (20th, Orlando, FL, 
November 2-5, 1995) 


EUiyi423 


Ihe assessment ot faculty-student 
interaction did not allow for the analysis of 
the duration of intensity of the interaction. 
How often or to what extent of 
participation could not be determined. A 
finite number of faculty-student variables 
are included (something like co-authoring 
an article is not included). The direction of 
influence between higher degree 
aspirations and faculty contact caimot be 
determined since they are measured at the 
same time. 
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Astin, A. (1993) "An tmpincal 
Typology of College Students.” 
Journal of College Student 


EJ459074“^ 


“Another constraining on studying 
interaction effects involving variables 
other than demographic characteristics 
(sex, age, race, etc.) is the lack of available 
measures of these other student 
characteristics. Although some of the 
typologies developed in earlier research 
suggest potentially interesting student 
characteristics that might interact with 
environmental experiences, there is no 
practical way for most investigators to 
incorporate such characteristics in their 
actual data. This limitation has to a certain 
extent been overcome in the current study, 
since the CIRP data necessary for using the 
typology already exist at several hundred 
institutions. Moreover, investigators who 
do not happen to have access to CIRP data 
can incorporate this typology into their 
own research at relatively low cost. 


Development, v. 34. (36-46). 








Astin, Alexander W. (1990). me 
Black Undergraduate; Current Status 
and Trends in the Characteristics of 
Freshmen. California Univ., Los 
Angeles. Higher Education Research 
Inst. 


ED320U43 


CIRP 197 1-89 
None cited 


Astin, Alexander W., Ana Others. 
The American Freshman: National 
Norms for Fall 1991. Higher 
Education Research Institute, 
Graduate School of Education, 320 
Moore Hall, University of California, 
Los Angeles, CA 90024-1521 
($20.00). Dec 91. 


EU34032F 


None cited. 


Astin, Helen S. and Kent, JLaura. 
(1983). Gender Roles in Transition: 
Research and Policy Implications for 
Higher Education. Journal of Higher 
Education. v54 n3 p309-24 May-Jun 
1983 


■ EJ2812/6 


ClKP1900-tSU 
None cited 


Bayley, Linda J. Changing 
Aspirations: An Analysis of College 
Student Status Aspirations. 20 Apr 92. 


■ HD34793y 


None cited. 


Braxton, John M., And Utners. t^eer 
Groups of Colleges and Universities 
Rased nn Student Outcomes. Journal 
of College Student Develonment v32 
n4 p302-09 Jul 1991. 


■ HJ4323T2“ 


The tindmgs from typological mquines 
are limited in many ways; for example, 
the degree to which the variable 
encompass the phenomenon under 
investigation and the extent to which the 
sample is representative of the population. 
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Both limitations are applicable to this 
study in that the seven variables do not 
capture the totality of educational 
outcomes that colleges and universities 
seek to instill in their students, nor are the 
38 institutions representative of the 
universe of institutions. 


Deppe, Manlyn J. (iy»9). Ihe impact 
of Racial Diversity and Involvement 
on College Students' Social Concern 
Values. ASHE Annual Meeting Paper. 


EU3 13982" 


CIRP 1982-86 

There were several limitations of the 
sample employed for the study. First, it 
was not representative of national higher 
educational racial diversity enrollment, 
with very low representation of minority 
groups other than Black students. Second, 
the average institutional racial diversity 
represented in the sample was below the 
national average, which limits the 
assessment in more diverse environments. 
Third, the geographical distribution was 
uneven and not representative of the 
national higher educational system. 


Deppe, Maniyn J. (19159.) Ihe Impact 
of Racial Diversity and Involvement 
on College Students' Social Concern 
Values. ASHE Annual Meeting Paper. 
Paper presented at the Annual Meeting 
of the Association for the Study of 
Higher Education (Atlanta, GA, 
November 2-5, 1989). 


EU3 13982" 


Not representative ot national higher 
education racial diversity enrollment. Very 
low representation from minorities, which 
limits the ability to study the research 
questions for minority groups. Not 
geographically representative of the 
national higher education system. The 
average institutional racial diversity 
represented was below the national 
average. 


Dey, Enc L. (1988.) College Impact 
and Student Liberalism Revisited: The 
Effect of Student Peers. ASHE 1988 
Annual Meeting Paper. Paper 
presented at the Annual Meeting of the 
Association for the Study of Higher 
Education (St. Louis, MO, November 
3-6, 1988). 


ED303066" 


Concern regarding reliability ot items. 
Very real possibility that results are 
influenced by the order of the items on the 
survey. 


Dey, Enc L. (1990). Evaluating 
College Student Retention: 
Comparative National Data from the 
1981-1984 Entering Freshman 
Classes. Paper presented at the Annual 
Meeting of the American Educational 
Research Association (Boston, MA, 
April 16-20, 1990). 


ED3 19320" 


CIRP 198 1-84 
None cited 
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Dey, tnc L. (1995.) Working with 
Low Survey Response Rates: The 
Efficacy of Weighting Adjustments. 
AIR 1995 Annual Forum Paper. Paper 
presented at the Annual Forum of the 
Association for Institutional Research 
(35th, Boston, MA, May 28-31, 1995). 


ED387018"' 


Response rate on the lollow up survey 
needs attention. 


Dey, Enc L., And Others. Does tseing 
Student-Centered Lead to Lower 
Academic Standards? Faculty 
Orientations and Undergraduate 
Grading Practices. AIR 1995 Annual 
Forum Paper. Paper presented at the 
Annual Forum of the Association for 
Institutional Research (35th, Boston, 
MA, May 28-31, 1995). 


ED38VU13" 


Finally, it should be noted that issues oi 1 
grade inflation are most naturally studied 
in a longitudinal fashion using sequential 
cohorts of data on students. Although 
these data raise interesting questions about 
some common assumptions about the 
process of grade inflation, these are raised 
indirectly. Institutional researchers with 
access to information on enrollment and 
grading trends over time can examine 
these questions directly using procedme 
such as time-series analysis. By bringing 
appropriate data resources to bear on this 
and related questions, institutional 
researchers can help unravel complex 
issues of concern to the higher education 
community. 


Uey, Enc L., Ana Others, ihe 
American Freshman: Twenty-Five 
Year Trends, 1966-1990. Higher 
Education Research Institute, 
Graduate School of Education, 320 
Moore Hall, University of California, 
Los Angeles, C A 90024-1521 
($25.00). 


ED340325'] 
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Dixon, terry E. use ot the 1995 
Clarkson College CIRP Summary To 
Determine the Presence of 
Institutional Outcomes Possessed by 
Entering Freshmen. 


ED392305 


None cited. 


Gruca, JoAnn M. and Uthers. (lyas). 
Intergenerational Effects of College 
Graduation on Career Sex Atypicality 
in Women. Research in Hieher 
Education. v29 n2 p99-124 Oct 1988 


■ EJ389U8r 


G1KP19/1-8U n 

The choice of variables was limited to 
variations of those included in the CIRP 
data set. It was not possible, for example, 
to include measures of certain home 
environment characteristics that might 
have mediated the influences of parents’ 
college graduation onto the next 
generation. The data set utilized also did 
not permit quantification of the period of 
time each parent may have resided in the 
family home.( 121) 




Gruca, JoAnn M. and Uthers. (1989). 
Intergenerational Effects of Parents' 
College Graduation: Comparative Path 


■ HD309688 


G1RP19/1-8U 
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Groups. Paper presented at the Annual 
Meeting of the American Educational 
Research Association (San Francisco, 
CA, March 27-31, 1989). 






Henderson, Uattiy. uollege hrestimen 
with Disabilities: A Triennial 
Statistical Profile. HEATH Resource 
Center, Department CFD, American 
Council on Education, One Dupont 
Circle, Washington, DC 20036. Aug 
95. 


HD3879'/r 


Students who respond to the (JIKP 
question are self-reporting their 
disabilities in the fall of their freshman 
year. It is unknown how long the students 
have lived with their conditions or 
whether they have ever been through a 
formal diagnostic process. 


Hess-Quimbita, Urace; Pavel, Micnael. 
(1996.) Assessing an Environmental 
Attitude Development Model: Factors 
Influencing the Environmental 
Attitudes of College Students. Paper 
presented at the Annual Meeting of the 
American Educational Research 
Association (New York, NY, April 8- 
12, 1996). 


EU394438 


bindings may be generalized to traditional 
:'irst-time, full-time college students only. 
Even though some variables lend to the 
impression of temporal positioning relative 
to each other, if they were in the same 
survey administration they were collected 
at the same time. The consideration that 
one causally precedes the other calls for 
caution when making conclusions about 
the order of these variables. 


Huang, Va-Rong.(i995.) ihe 
Accentuation Effect of Academic 
Majors on Undergraduate Work Values 
and Holland's Theory. ASHE Annual 
Meeting Paper. Paper presented at the 
Annual Meeting of the Association for 
the Study of Higher Education (20th, 
Orlando, FL, November 2-5, 1995) 


ED3914U8 


Lack ot Items which measure students 
work values or job characteristics that are 
important. Major, as a proxy for 
department influence, would be better if 
the degree of involvement of the 
department was measured, or if the length 
and depth of involvement with the 
department environment was measured. 


Hull-ibye, Carolyn Sue. Persistence 
Based upon Degree Aspirations. 

ASHE Annual Meeting Paper. Paper 
presented at the Annual Meeting of the 
Association for the Study of Higher 
Education (20th, Orlando, FL, 
November 2-5, 1995). 


HD391414“ 


A better measurement, of course, would 
be to include both quality of effort and 
satisfaction measures of the college 
experience. 


Hurtado, Sylvia, And Others 
Varieties of General Education 
Programs: An Empirically Based 
Taxonomv. Journal of General 
Education v40 pi 33-62 1991 


EJ436356 


None cited. 


Hurtado, Sylvia, And Others. Social 
Interaction on Campus: Differences 
among Self-erceived Ability Groups. 
AIR 1995 Annual Forum Paper. Paper 
presented at the Annual Forum of the 
Association for Institutional Research 
(35th, Boston, MA, May 28-31, 1995). 


ED38/U14 


Institutional researchers engaged in 
developing assessment of campus 
diversity, should include student 
perceptions of the climate, as well as 
actual behavioral measures or reports of 
interaction across race/ethnicity to 
adequately assess the extent of social 
interaction on campus. 


Hyun, MeHee. Helping 1 o Promote 
Racial Understanding: Does It Matter 


ED375710 


■ The issue of race is complex, and whether 
increasing students’ commitment to racial 
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if You're Black or WhiteV ASHE 
Annual Meeting Paper. Paper 
presented at the Annual Meetiiig of the 
Association for the Study of Higher 
Education (19th, Tucson, AZ, 
November 10-13, 1994). 




understanding can be completely I 

explained by one or any of these models is 
unlikely. ..If these variables may raise 
students’ desire to promote racial 
understanding, besides having the virtue 
of enhancing student development, they 
are certainly worth investigating fiirther. 


Jacobs, Jerry A. tiender and Academic 
Specialties: Trends among Recipients 
of College Degrees in the 1980s. 
Sociolopv of Education v68 n2 p81-98 
Apr 1995. 


EJ 502244 


However, 1 have no direct data on whether 
larticular occupations became more 
'amily friendly during this period, and, 
consequently, this explanation cannot be 
ruled out. . . .Data on methematics 
jerformance are available, but data on the 
extent to which concern about 
mathematics may affect the choice of 
majors are not available on a consistent 1 

jasis for this period. 


Kent, Laura. (198Z). Puerto Kicans in 
U.S. Higher Education: Current Status 
and Recent Progress. Higher 
Education Research Inst., Inc., Los 
Angeles, Calif. 


ED226692" 


None cited 


Korn, Jessica S. (lyyo.) loierating tne 
Intolerable: Examining College 
Students' Attitudes about Date Rape. 
ASHE Annual Meeting Paper. Paper 
presented at the Annual Meeting of the 
Association for the Study of Higher 
Education (20th, Orlando, FL, 
November 2-5, 1995). 


ED391415 


Lack ot a tollow up survey tor the 1990 
freshman cohort. Contains only a simple 
date rape item. 


Lawrence, Judith K. and Uthers. 
(1982). The Handicapped Student in 
America's Colleges: A Longitudinal 
Analysis. Higher Education Research 
Inst., Inc., Los Angeles, Calif. 


EU226094 
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Leslie, Larry L. (1982). btudem 
Financing. National Center for Higher 
Education Management Systems, 
Boulder, Colo. 


EU24682ir 


I'he NLb surveys provide the best stuaent 
financing data. Its demographic or 
independent variable data are excellent. 
Further, financing data are actual as well 
as expected. Some nonstudent data are 
available as well. 

The major strength of CIRP are that it 
provides time-series data and detailed 
student demographic financing data. Its 
limitations are that it samples only first- 
time, full-time freshmen; the financing 
data are expected sources of support rather 
than actual or realized financing sources. | 
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A turther limitation is that these data are 
in ordinal rather than nominal form. 


Leslie, Larry L. (1984). Changing 
Patterns in Student Financing of 
Higher Education. 

Journal of Higher Education. v55 n3 


EJ299882 


CIRP 1972-76 and 1973-8U 

CIRP data essentially are limited to first- 
time, full-time freshmen, whereas the 
NLS reports on part-time as well as full- 
time students and is not limited to first- 
time enrollees. CIRP excludes students 
attending proprietary, special vocational, 
and semi-professional institutions, 
whereas the NLS includes all 
postsecondary students. A less significant 
difference is that CIRP excludes students 
from very small institutions. NLS data for 
the most part represent actual student- 
reported expenditures, where CIRP data 
reflect student expectations at the time of 
registration, and that NLS data are 
nominal whereas CIRP data are converted 
from ordinal to nominal form through 
estimating procedures 


p3 13-46 May-Jun 1984 


Litten, Larry H.; Kern, Kathleen. 
Social/Political Liberalism Among 
Freshmen at Selective Private 
Institutions; A CIRP Data Sharing 
Project. Annual Forum Paper. Paper 
presented at the Annual Forum of the 
Association for Institutional 
Research (33rd, Chicago, IL, May 16- 
19, 1993). 


ED36U936 


1 hese data also indicate that it would be 
useful for CIRP to report institutional 
scores (and norms) for summary indexes 
that synthesize the voluminous data that 
merge from the Student Information 
Form. 


Maxwell, James P. and Corrallo, 
Salvatore B. (1984). How Do Student 
College Finances Vary by Student and 
Institutional Characteristics? Paper 
presented at the Annual Meeting of the 
American Educational Research 
Association (68***, New Orleans, LA, 
April 23-27, 1984). 


ED245649 


CIRP 1982 
None cited 


McDonough, Patncia M.; Antonio, 
Anthony Lising. Ethnic and Racial 
Differences in Selectivity of College 
Choice. Paper presented at the Annual 
Meeting of the American Educational 
Research Association (New York, NY, 
April 8-13, 1996). 


Ed394466 


This vanation suggests the existence of 
multiple selective college choice habiti 
that have been and are continuously honed 
by the interaction of individual students 
with the administrations structure they 
face. Research detailing the development 
of these habiti for different ethnic groups 
is necessary to provide additional insight 
into the ways the selective college access 
game differentially pays off students by 
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race. 


McHale, Maureen i. Ihe impact oi 
College on Students' Attitudes toward 
Women's Roles. ASHE Annual 
Meeting Paper. Paper presented at the 
Annual Meeting of the Association for 
the Study of Higher Education (19th, 
Tucson, AZ, November 10-13, 1994). 


ED375/11 


None cited. 


Mencke, Reed ana Others. (,1^^^)- 
Assessing Institutional Effects on 
Retention. AIR 1988 Annual Forum 
Paper. 


ED298855T 


CIRP ly 85-80 

The data available did not allow us to 
distinguish between voluntary and 
involuntary withdrawal, and important 
distinction in the Tinto model. 


Moline, Arlett E.; Hendel, Darwin u. 
Exploring International Issues through 
the Use of CIRP Data. AIR 1992 
Annual Forum Paper.May 92. Paper 
presented at the Annual Forum of the 
Association for Institutional Research 
(32nd, Atlanta, GA, May 10-13,1992). 


ED349864 


though the CIRP btudent intormation 
Form contains many different variables 
often considered dependent, the survey 
had relatively few questions focused on 
international questions and concerns, 
thereby limiting the use of CIRP data. 


Opp, Ronald U. (iy89). hresnmen 
Interest in Teaching: Recent Trends. 
Journal of Teacher Education. v40 n4 
p43-48 Jul-Aug 1989 


EJjyy/uin 


CIRP ly 00-88 
None cited 


Pascarella, Ernest i . and utners. 
(1987). Becoming a Physician; The 
Influence of the Undergraduate 
Experience. Research in Higher 
Education. v26 n2 pl80-201 1987 


EJ35693y n 


ClRPiy/l-80 

With only one follow-up, the 
configuration of the CIRP data makes it 
nearly impossible to separate the effects of 
aspiration changes during college from 
failure to get into medical school. The 
data follow students only over a nine-year 
period from first enrollment as college 
freshmen. Consequently, while we can 
determine who becomes a physician, we 
cannot determine the effects of college, if 
any, on subsequent success within the 
profession. Similarly, the occupational 
categories provided by the data do not 
permit the possible explanation of 
differential statuses within medicine. 


Pascarella, Ernest 1 . and utners. 
(1988). The Influence of College on 
Humanitarian/Civic Involvement 
Values Journal of Higher Education. 
v59 n4 p412-37 Jul-Aug 1988 


■ HJ376514” 


C1RP1971-8U 1 

The measure of social leadership 
experiences during college, for example, 
consisted of only four items and was 
limited to assessing participation or 
nonparticipation. Obviously, influential 
student involvement in an institution’s 
social system could consist of a | 
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substantially greater range ot experiences 
than those constituting the scale in its 
present form. Similarly, the quality or 
intensity of involvement may be of even 
greater impact than simple measures of 
participation or nonparticipation. A 
related measurement issue concerns the 
dependent variable: the humanitarian/civic 
involvement scale. The problem with 
assessing values by means of a 
questionnaire instrument is that an 
individual’s stated values are not always 
predictive of behavior. Despite the 
national sample on which the analyses 
were conducted, the generalizability of the 
results are also limited to those black and 
white students who attended only one 
undergraduate institution. This was 
necessitated by the fact that the structural 
information(for example, size, selectivity) 
on institutions in the CIRP data referred 
only to the first institution attended, 
whereas college experience data referred 
only to the last institution attended. 


Pascarella, tmest 1 . and Others. 
(1989). College Race and the Early 
Status Attainment of Black Students. 
Journal of Hieher Education. v60 nl 


EJ385654 


CIRP 197 1-80 

The data did not contain a pure measure of 
student intellectual ability. This is perhaps 
not an overly serious limitation, however, 
in that the data did permit assessment of 
high-school rank in class as well as high- 
school grades. The study is obviously 
limited by the time over which the sample 
was followed; nine years after original 
enrollment as full-time freshmen. 


p82-107 Jan-Feb 1989 


Pascarella, Ernest I', and Smart, John 
C. (1990). Impact of Intercollegiate 
Athletic Participation for Afncan 
American and Caucasian Men; Some 
Further Evidence. Journal of College 
Student Develonment. v32 n2 pi 23-30 


■ EJ408762“ 


CIRP 1982-86 

Although the present study has the 
significant benefit of being longitudinal, 
the fact that it used students who entered 
college and then were followed four years 
later caused the dropout rate of the 
original group ofp^icipants to be 
significant. A large number of those in the 
initial smaple did not complete the follow- 
up. Data are based on self-report and 
retrospective measures of change and 
institutional characteristics .( 186) 


Mar 1991 


Phelan, Jo Carol and Phelan, ihomas 


EU23254iF 
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None cited 
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None cited 


Phelan, Ihomas James and I'nelan, Jo 
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Early Life Outcomes. Higher 
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HJ293454~ 


C1RP19/U-// 

While college experience might well 
shape personality, a drawback of the CIRP 
data for our purpose is the absence of 
affective measures adequate for testing 
such a notion. 


Porter, Oscar P. (1987). A 
Comparative Analysis of the 
Characteristics of Private Black 
College Freshmen: Implications for 
the Future of Black Leadership in 
America. United Negro College Fund, 
Inc., New York. 
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None cited 
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Study: A Changing Profile. Paper 
presented at the Annual Meeting of the 
American Educational Research 
Association (New Orleans, LA, April 
23-27, 1984). 


ED249824" 


CIRP 1967, 72, /5, 8l 
None cited 
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Paper presented at the Annual Meeting 
of the Association for the Study of 
Higher Education (Minneapolis, MN, 
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Response bias exists; respondents tend to 
be of higher academic ability than non- 
respondents, which means that items such 
as math ability self rating may be skewed. 


Sax, Linda J.; Arredondo, Mansol 
Student Attitudes toward Affirmative 
Action in Higher Education: Findings 
from a National Study. Paper 
presented at the Annual Meeting of the 
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CIRP (Cooperative Institutional 
Research Program) Freshman Survey 
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College of Technology, Williamsport. 
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Response bias exists; CIRP is not 
representative of the entire full-time 
entering class (attributed to test 
administration circumstances). 


Smart, John C. (iy» /). Student 
Satisfaction with Graduate Education. 
Journal of Colleee Student Personnel. 


EJ357768“ 
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None cited 
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Smart, John C. (1988). Lite History 
Influences on Holland Vocational 
Type Development. ASHE 1988 
Annual Meeting Paper. 


EU3UiU8U 


ClRPiy/l-8U 

The study was limited to these three 
vocational types because they comprise 
the majority of occupations that college 
students typically enter and because the 
CIRP survey did not contain measures to 
assess Realistic, Artistic, and 
Conventional personal orientations in 
1971. 


Smart, John C. and Pasacarella, 

Ernest T. (1986). Socioeconomic 
Achievements of Former College 
Students. Journal of Higher Education, 
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ClRPiy 71-80 
None cited 
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Education. v26 n2 p202-l 1 1987 
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response to user demahd. 



NCPI Project 5.3, 06/12/97 



12 



I sui, Lisa. (1995.) Boosting hemale 
Ambition: How College Diversity 
Impacts Graduate Degree Aspirations 
of Women. ASHE Annual Meeting 
Paper. Paper presented at the Annual 
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developed by Astin and used in this study 
provided a good understanding of 
institutional environmental variables that 
contribute to a general “multicultural” 
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understood the researcher’s intended 
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Zilbert, H. (1992). Selection bias' 
and the earnings effects of 
postsecondary vocational education. 
Journal ofVocational Education 
Research. 17(1), 11-34. 



HJ47705T 



NELS88 



A Profile ot the Amencan 8th (irader 


ED360352" 


N/A Research in Bnet Report 


National Education I.ongitudinal Study 


of 1988. Research in Brief 


Anderson, J.& Others. Poverty and 
Achievement: Re-examining the 


ED34b2UV 


None cited. 


Relationship between School Poverty 


and Student Achievement: An 


Examination of 8th Grade Student 


Achievement using the National 


Education Longitudinal Studv of 1988. 




3obbitt, S. A. using Opportunity to 
Leam Items in Elementary and 


ED36366T 


S rRbNGlH: great deal ot information on 
secondary students’ opportunity to learn 
(e.g., classroom characteristics, descriptors 
of course content, etc.) 


Secondarv National Surveys. 




Rrarifinr.k, J. hi.. 11. irackmg: 
Imnlications for Student Race-Ethnic 


ED3256UU 


None cited. 


Subgroups. Report No. 1. 


Campbell, P. B. & Laughlm, S. 
Particination in Vocational Education: 


"ED3IS797" 


None cited. 


An Overview of Patterns and their 


Outcomes. 


Charactenstics ot New York State s 


ED34073r 


NELS:88 sample excludes Bureau ot 
Indian Affairs (BIA) schools, special 
education schools for the handicapped, 
area vocational schools that do not enroll 
students directly, and school for 
dependents of U.S. personnel overseas. 
Exclusion of BIA schools could 
significantly skew and bias the American 
Indian sample. In addition, students who 
are educated at home or in private tutorial 
settings and those who have dropped out 
of school prior to 8th grade are excluded. 


8th Grade Students from the National 


Education Longitudinal Studv of 1988. 




Choy, Susan P., and Uttiers. 

America's Teachers: Profile of a 
Profession. U.S. Government Printing 
Office, Superintendent of Documents, 
Mail Stop: SSOP, Washington, DC 
20402-9328. 


■ HD359185- 


Data was more detailed on math and 
science instruction than on English and 
social studies instruction. 
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Dray.en. S. Student Achievement and 
Family and Community Poverty; 
Twenty Years of Education Reform. 


ED3'46234“' 


No mtormation on high school tmancial 
resources in the NLS-72, and non-similar 
questions about resources were asked in 
the HS&B and NELS;88. 


Drazen. S. Student Achievement and 
Family and Community Poverty; 
Twenty Years of Education Reform. 


ED3462J4 


No mtormation on high school imancial 
resources in the NLS-72, and non-similar 
questions about resources were asked in 
the HS&B and NELS;88. 


(ieenen, Knsten, and Uthers. (1995.) A 
Disability Perspective on Five Years of 
Education Reform; Synthesis Report 
22. National Center on Educational 
Outcomes, University of Minnesota, 
350 Elliott Hall, 75 East River Road, 
Minneapolis, MN 55455. 


ED3964/6” 


‘The sample size ot NELS 88 vanes 
through the study due to freshening the 
sample in order to account for dropouts, 
transfers, and subjects found to be 
ineligible.” “Few analyses have been 
completed on this subsample (students 
with disabilities), primarily due to the 
difficulty associated with identifying 
students with disabilities in this data set. 
Identifying disability status within 
NELS;88 is contingent upon maternal 
responses to two items.” 


Ureen, Patncia J., And Uthers. (1995.) 
Trends among High School Seniors, 
1972-1992. National Education 
Longitudinal Study of 1988. Statistical 
Analysis Report. U.S. Government 
Printing Office, Superintendent of 
Documents, Mail Stop; SSOP, 
Washington, DC 20402-9328. 


ED38/533 


NELb88 has high consistency ot 8th 
grader and parent responses. 


Grubb, W. Norton. (1990.) the 
Decline of Community College 
Transfer Rates; Evidence from 
National Longitudinal Surveys. 
Department of Education, Washington, 
DC.; National Assessment of 
Vocational Education (ED), 
Washington, DC. 


ED315125 


Period of transcript coverage is too short, 
and is insufficient to meet the patterns of 
students in longer programs or who take 
longer to complete programs. This is 
especially true of transfers. This data also 
excludes older students. 


Hatner, A.. Uwmgs. t . Careers m 
Teaching; Following Members of the 
High School Class of 1972 In and Out 
of Teaching. Analysis Report. 
National Longitudinal Studies of the 
High School Class of 1972. 


HU336386 


None cited. 


Henderson, L. & Levmsohn, J. 
National Longitudinal Study of the 
High School Class of 1972. School 
File Documentation. 


ED3134U1 


None cited. 


Hilton, r. L. & Lee, Valene E. (1988). 
Student interest and persistence in 
science; Changes in the educational 
pipeline in the last decade. Journal of 
Higher Education. 59(5), 510-26. 


EJ38U261 


Asian Americans excluded from study 
because of low sample size. Majority of 
student data is self-reported, which can 
lead to bias or error. 
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Hnachlander. b. Ci. A brotile ot 
Schools Attended bv 8th Graders in 


-EmmET' 


Notes that limitations ot the NELlS:8b are 
artir.iilated in NORC. (19891. National 
Education Longitudinal Study of 1988 


1988. Statistical Analysis Report. 


Base Year: Student Component Data File 


National Education Longitudinal Study 


User’s Manual. NORC: Chicago, IL. 


of 1988. 


1.. /fe Others. A Protile ot 
American 9th Grade Mathematics and 


ED347094" 


Teacher component ot the NELS is not 
nationally representatiye, eyen though the 
student sample is. NELS:88 sample 
excludes Bureau of Indian Affairs (BIA) 
schools, special education schools for the 
handicapped, area yocational schools that 
do not enroll students directly, and school 
for dependents of U.S. personnel oyerseas. 
Exclusion of BIA schools could 
significantly skew and bias the American 
Indian sample. In addition, students who 
are educated at home or in priyate tutorial 
settings and those who haye dropped out 
of school prior to 8th grade are excluded. 


Science Instruction. National 


Education Longitudinal Study of 1988. 


Statistical Analysis Report. 


Hnm. 1 . & West. J. A Protile ot 
Parents of 8th Grade Students from the 


HD35035T 


Parent data m NELb:88 is not nationally 
representatiye, eyen though the student 
data is. The majority of parents (-85%) 
who responded to the suryeys were 
mothers, so results may be biased in terms 
of the mother’s yiew of the child. 


National Education Longitudinal Study 


of 1988. 




Huang, G. G. Selt-Keported illiteracy 
and Self-Esteem: A Study of Mexican 
American 8th Graders. 


HD35693V 


None cited. 


Huang, J. & (Jeryero, R. M. Adult 
Education and Inequality. 


ED351450 


None cited. 


Ingels S. J. strategies tor including 
All Students of National and State 


ED363645 


Mentally disabled, language disabled, and 
physically disabled children omitted from 
BY sample. 


Assessments: Lessons from a National 


Longitudinal Study. 


Ingels, s J. & Others. National 
Education Longitudinal Study of 1988. 


"ED32222T 


8th grade teachers selected for the survey 
were only the teachers of the students who 
were in the student sample, and only 4 
subject areas were chosen. Therefore, 
researchers are cautioned not to use the 
teacher components on the NELS under 
the belief that it is a random sample. 
Furthermore, teacher-student comparisons 
(as opposed to student-teacher comparison 
level data) is not encouraged. 


Base Year: Teacher Component Data 


File User’s Manual. 




Ingels, s .1. &. Others. National 
Education Loneitudinal Study of 1988. 


■ ED32222J 


Same limitations cited as ED322222. 


Base Year: School Component Data 


File User’s Manual. 
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Ingels, is. J. & Uthers. ischooi. 
Individual and Item Nonresoonse in 
the National Education Longitudinal 
Studv of 1988 rNELS:88) Base Year 
Survey. 


ED312Trr' 


Due to sampling realities, responses trom 
students who are mentally handicapped, 
not proficient in English (but still 
oversample of Latinos and Asians?--are 
they all non-recent immigrants then?), and 
having physical or emotional problems. 
This was only 5% of original sampling 
frame. School-level and individual-level 
non-response handled through 
school/individual replacement of like 
students, and/or weighting/flags to adjust 
for non-response. Individual item non- 
response not adjusted for. 






Jackson, (i. A. (.1988). Uid college 
choice change during the Seventies? 
Economics of Education Review, 
7(1), 15-27. 


HJ376197“ 


No into on local economic conditions or 
descriptions of nearby colleges and 
universities. HS&B contains only 
student self-reported grades. Many 
financial-aid categories were misleading, 
since many respondents were flagged as 
missing-made it look like there were tons 
of people on aid, but many were coded as 
“missing” in the value labels. 


Kautman, P. & Kasinski, K.. A. 

Oualitv of Resoonses of 8th Grade 
Students in the NELS:88— National 
Education Longitudinal Studv of 1988. 
Technical Report. 


ED339/22 


Quality of responses (i.e., internal 
consistency and comparability to parents’ 
responses) of 8th graders not as high as 
similar HS students in the HS&B. 

Students from high SES backgrounds, 
those with higher abilities in reading. 
White or Asian students, and females were 
more likely to give valid answers than 
their peers. 


Keith, P. B. & Lichtman, M. 1 estmg 
the Influences of Parental Involvement 
on Mexican-American 8th Grade 
Students’ Academic Achievement; A 
Structural Equations Analysis. 


"ED35TT7D" 


None cited. 


McGrew, Kevin S., And Uthers. 

(1995.) Matching Information in 
National Data Collection Programs to a 
Model of Post-School Outcomes and 
Indicators. Technical Report 17. 
National Center on Educational 
Outcomes, University of Minnesota, 
350 Elliott Hall, 75 East River Road, 
Minneapolis, MN 55455 


ED39648J 


“NELS88 could not be included due to the 
lack of a published technical or 
methodology report for the third follow-up 
at the time of this investigation.” 

“Most pressing is the need to develop or 
employ existing outcome indicators related 
to accepting the consequences of one’s 
behavior (responsibility and 
independence), academic and functional 
literacy, personal and social adjustment 
and satisfaction.” 
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McUrew, Kevin. (1995.) Disability 
Summary Analyses of Select National 
Data Collection Programs. Technical 
Report 1 1 . National Center on 
Educational Outcomes, University of 
Minnesota, 350 Elliott Hall, 75 East 
River Road, Minneapolis, MN 55455 


HD39647’r‘ 


Individuals were excluded it they were had 
severe mental or physical disabilities. 
Students at specialized special education 
schools were also excluded. 


Morgan, L. A (1988). Uutcornes oi 
marital separation: A longitudinal test 
nf prpHirtnrs Journal of Marriage and 
the Familv. 50(2). 493-98. 


EJ 3 78524 


N/A Used National Longitudinal Survey 
Cohort of Mature Women 


Owens, E. W. & waxman, H. U. 
(1995-96). Differences among urban, 
suburban, and rural schools on 
technology access and use in eighth- 
grade mathematics classrooms. 
Journal of Educational Technologv 
Svstems. 24(1), 83-92. 


EJ 5 18438 


None cited. 


Passmore, D. L. & Others. 
Epidemiologv of Work Injuries among 
Former Particinants in Vocational 
Education. 


HD341827" 


N/A Used National Longitudinal Surveys 
of Labor Market Experience 


Peters, E. H. (1988). Retrospective 
versus panel data in analyzing lifecycle 
events. Journal of Human Resources, 
23(4), 488-513. 


HJ381301 


N/A. Used National Longitudinal Survey 
of Work Experience (NLS) 


Planning Papers lor the National 
Longitudinal Study of 1972. 
Implications for Schools under Chapter 
1. 


ED31U150 


Paper is presentation of "advice from the 
masters.” NCES commissioned several 
experts to suggest what should be included 
in a longitudinal study of elementary and 
secondary education. While N/A for 
limitations, may be useful in the design of 
our own surveys. 


Sares^ T. A. 5ichool Size Ellects on 
Educational Attainment and Ability. 


HD34874J" 


None cited. 


Schneider, B., Schiller, K. S., & 
Coleman, J.S. (1996). Public school 
choice: Some evidence from the 
National Education Longitudinal Study 
of 1988. Educational Evaluation and 
Policy Analysis. 18(1). 19-29. 


EJ52542r^ 


Racial/ethnic groups and parent education 
levels distributed unevenly across central 
city, suburban, small town, and rural 
school districts. 8th grade base year 
sample respondents who did not 
matriculate to the same high school as 
their classmates were generally not 
followed-up, making the HS sample 
skewed by those who did not move. 


Shin. H-S. Estimating Future leacher 
SuDolv: An Aonlication of Survival 
Analysis. 


ED36//2U 


None cited. 
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Sosniak, L. A. & ttnington, a. 
(1992). When public school “choice” 
is not academic: Findings from the 
National Education Longitudinal Study 
r.fl988 Education Evaluation and 
Policy Analysis. 14(1), 35-52. 


HJ4466'6'4“ 


High school choice not random; subjects 
chosen by purposeful selection in 8th 
grade. 

NELS data does not provide information 
about HS topic presentation (although it 
does say the actual topic taught in HS), 
how students are expected to think about 
the topic, the nature of classroom 
discussions, lab work, etc. in HS. 




User’s Manual tor ly/U Census t-ounn 


ED3ii4l5 

ED313416 


No limitations reterenced, but intormation 
on how portions of the Census can 
supplement the main data files of the NLS- 
72. 


Count (Ponulation'l School Distnct 


Data Tanes. 





NLS72 



Adelman, Clittord. (iy90.) Light and 
Shadows on College Athletes; College 
Transcripts and Labor Market History. 
Superintendent of Documents, U.S. 
Government Printing Office, 
Washington, DC 20402. 


HD32/112" 


This data provides unequivocally accurate 
long term college graduate rates, detailed 
data on college courses taken, and data on 
labor market participation. Because it 
follows high school seniors no rnatter what 
they subsequently do, it is not distorted by 
decisions to study specific groups of 
students. 


Altonji, J.G. (lyyo). iheettectsoi 
high school curriculum on education 
and labor market outcomes. Journal of 
Human Resources. 30 (3), 409-438. 


EJ507818” 


Strength: 

-Includes number of semester hours taken 
in high school in a number of subject 
areas 

-Includes family background, parental 
attitudes toward education, test scores, 
and high school characteristics 
-Includes several students from each of 
897 high schools sampled - this allows use 
of the means for each HS of courses taken 
in each subject as instrumental variables 
for the courses chosen by individuals 
while controlling for other characteristics 
of the individual students and for HS 
variables such as the average 
characteristics of the students in the HS 
Weakness: 

-Attrition rates are greater for those with 
disadvantaged backgrounds and for 
persons who took fewer academic courses 
NOTE: 

HS&B DATA SET CONTAINS 
SUPERIOR CURRICULUM 
MEASURES TO NLS AND PROVIDES 
THE OPPORTUNITY TO CONTROL 
FOR ABILITY AND APTITUDE PRIOR 
TO THE 10™ GRADE. 
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Aplmg, Richard N. (1991.) 
Postsecondary Educational 
Experiences of High School Graduates. 
CRS Report for Congress. 


ED332627"' 


Data collected trom students over a multi- 1 
year period are critical for examining 
jostsecondary experiences. The 1980 
senior cohort of HS&B dataset provides 
two more years of data after high school 
than does the 1980 sophomore cohort. 

'here is insufficient data in the sets that 
lave only four years because the average 
3. A. completion for the high school class 
of 1 972 was 4.5 years and now may be 
onger. 


Brown, S.V. (19S»). Minorities in the 
graduate education pipeline. A research 
report of the minority graduate 
education MGE) Program. 


ED2999U0 


None cited. | 


ramphell,~P.B. 119X41. Iransition 
patterns between education and work. 


HD240272 


Strength: 1 

-Includes high school course-taking 
patterns 


Columbus, OH: National Center for 
Research in Vocational Education, 
Ohio State University. 


Constantine, J.M. (1995). i he etieci 
of attending historically black colleges 
and universities on future wages of 
hlnrlf shidents. Industrial and Labor 
Relations Review. 48 (3), 531-546. 


EJ 500X10“ 


Strength: \ 

-very few black respondents’ observations 
were lost due to unusually high or low 
hourly wages 
Weakness: 

-over 3000 black students were in NLS- 
72, but there were only good wage 
observations in 1986 for about 1 192 of 
them (therefore, small sample size for this 
survey) 




Crouse,). (1985). Does the SAi help 
colleges m^e better selection 
der-isinns? Harvard Educational 
Review. 55 (2), 195-219. 


EJ317811 ■ 


None cited. 


Dawkins, M.P. (1989). ITie 
persistence of plans for professional 
careers among blacks in early 
adnitbood. Journal of Negro 
Education. 58 (2), 220-231. 


■ HJ 390020" 


Strength: | 

-Good for studying a wide range of 
characteristics of young people (including 
family background, aspirations and 1 

expectations, post-high school educational 
and occupational plans and experiences, 
other attitudes and activities) as they move 
into early adulthood 
-large database 
Weakness: 

-no measure of the respondents’ ^ 

perceptions of the openness of society’s 
occupational structure 




Ehrenberg, R.G, and Sherman, U.K. 


“ EJ 346597" 


None cited. 1 
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(19» /). hmployment while in college, 
academic achievement, and 
postcollege outcomes: A summary of 
results. Journal of Human Resources. 
22(1), 1-23. 






Fitzgerald, Robert, And Uthers. (iyy4.j 
Descriptive Summary of 1989-90 
Beginning Postsecondary Students: 
Two Years Later. Contractor Report. 
Statistical Analysis Report. U.S. 
Government Printing Office, 
Superintendent of Documents, Mail 
Stop: SSOP, Washington, DC 20402- 
9328. 


HD3726iH“ 


NLS72 and HS&B are limited to members 
of a single high school class/cohort. 


Frazis, H. (1993). "^election Bias and 
the Degree Effect.” Journal of Human 
Resources, 28(3). 538-554. 




“As the 1986 survey followed up less than 
70 percent of college dropouts and 
nonattenders, the wage data come from the 
fourth followup in 1979... .The major 
disadvantages are the youth of the 
respondents (seven years out of high 
school), and the lack of cross-sectional age 
variation, which makes estimation of 
potential experience terms in the wage 
equation impossible. . ..The NLS-72 
categories for college-goers who stopped 
short of a BA distinguish only between 
two or more and less than two years of 
college.” 




Gittord, A.G. et al (Apnl 1989). 
Course enrollment nattems in 


LD3 15646 


Strength: 

None cited. 

Limitation: 

Not enough cases to estimate credits for 
the class of 1975 separately. 


secondarv schools 1975-1987. 




Grubb, N. W. (1992). Correcting 
conventional wisdom: Community 
college impact on students’ jobs and 
salaries. Communitv. Technical, and 
Junior Colleee Journal. 62 (6). 10-14. 


hJ 44629 7 


Strength: 

-Includes transcripts of every 
postsecondary institution an individual 
attended 

-Includes wages and earnings as of 1986 
-Includes a large number of demographic 
characteristics, family background, high 
school performance, labor market 
experience 
Weakness: 

-Does not include older students 
-Reflects many now-dated college 
experiences from the mid- 19 70 ’s 
-Fail to consider labor market variations 
from community to community 
-Cannot distinguish between community 
and technical colleges 
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Grubb, W. (1993). “i'he Vaned 
Economic Returns to Postsecondary 
Education: New Evidence from the 
Place nf 1 972.” Joumal of Human 
Resources, 28(2): 365-382. 


EJ462059 


“ I he NLS 72 data have some limitations, 
notably their restriction to a single cohort 
passing through postsecondary education 
during the 1970s” 


Grubb, W. (1995). 'Tostsecondary 
Education and the Sub-Baccalaureate 
Labor Market: Corrections and 
pvtpncinnc ” Economics of Education 
Review, 14:285-299. 


EJ5 14681 


“ The complications ot using data based on 
a single cohort and of ‘uncleaned’ versus 
‘cleaned’ versions, the problems of 
incomplete transcripts, the enormous 
amounts of missing data, the complexity of 
using information on credits from non- 
comparable institutions, the problems 
caused by non-random sampling and non- 
random response rates - all these make any 
definitive analysis virtually impossible. In 
this as in other areas of empirical works, 
therefore, the only real solution is to use 
several data sources to investigate patterns 
of interest. . .. The major advantage of 
SIPP data is that they include all age 
groups, rather than a single cohort like the 
NLS72. 


Grubb, W. Norton. (1989.) Ihe causes 1 
and Consequences of Enrollments in 
Higher Education: Evidence From the 
National Longitudinal Study of the 
Class of 1972. Final Report. Institute 
for the Study of Family, Work, and 
Community, Berkeley, CA. 


ED31837F 


I'he tremendous advantage of this data is 
that it provides finely detailed information 
about postsecondary education, not merely 
an estimate of years in school. A 
disadvantage of the data is that it provides 
information about only one graduating 
class. Consequently there is no real 
variation in age in the sample, so it is 
impossible to analyze the effects of 
education on employment over many 
years. And although the fifth follow-up 
occurred 14 years after high school, this is 
still not long enough to come close to 
maximum individual earnings. The results 
reflect the experiences of a cohort passing 
through postsecondary education in the 
1970s. This may not be valid for cohorts of 
the 1980s, when postsecondary education 
conditions changed. There is no 
comparable dataset. 
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Harmitord, Barbara B.; bagana, Mary 
Ann D. (1994.) The Impact of Work 
and Family Roles on Associate and 
Baccalaureate Degree Completion 
among Students in Early Adulthood. 
Paper presented at the 1994 Annual 
Meeting of the American Educational 
Research Association (New Orleans, 
LA, April, 1994). 


ED3/052U 


3 . 26 and 27: "Measures ot academic 
integration and finances applicable to the 
entire sample were not available. Also, any 
errors in recall of dates affected the 
reliability of measures constructed from 
data information. Moreover, because the 
sample was selected on the basis of 
students' stated degree goals, its validity is 
subject to the accuracy and honesty with 
which students reported these goals. 
Likewise the dependent variable measure 
relies on students accurately reporting 
degree outcomes. Finally, the cohort 
studies and age range of the sample are 
important. Results may not be 
generalizable to more recent cohorts and to 
older populations of students." 


Heyns, B. (1988). Bducational 
defectors; A first look at teacher 
attritinn in theNLS-72. Educational 
Researcher. 17 (3), 24-32. 


EJ372883 


Strength: 

-Extensive work history information 
-Rich data base for study of career 
mobility 


Hollenbeck, K. (1992). 
Postsecondarv education as triage. 
Returns to academic and technical 
programs. Staff working papers. 
Kalamazoo, MI: W.E. Upjohn 
Institute for Employment Research. 


EU38168/ 


None cited. 


Jackson, (i. (1988). “Did College 
Choice Change During the Seventies?” 
Economic of Education Review. 7:15- 
27. 


EJ3/619/ 


“Identitymg Dropouts requires data on 
individuals’ high school experiences. 
Distinguishing Completers from Starters 
requires data on college persistence over 
several years. But such longitudinal data 
are rare, and so we make do (here as 
elsewhere) with analyses of high school 
graduates’ college entry decisions - which 
means Dropouts do not exist, and Starters 
are equivalent to Completers. ...We have 
only a dichotomy between no college entry 
and college entry, and samples that 
exclude high school dropouts. 

Exacerbating this problem, college entry 
by high school students is in a sense the 
least important of the three major decision 
points involved in college degrees: high 
school completion, college entry, and 
college completion. “ 


Kim, M., and Alvarez, R. (1995). 
Women only colleges; Some 
unanticipated findings. Journal of 
Higher Education. 66 (6), 641-668. 


■ HJ 5 16405 


Strength: 
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Knepper, Paula K. (1989.) btucient 
Progress in College: NLS-72 
Postsecondary Education Transcript 
Study, 1984. Survey Report. National 
Center for Education Statistics (ED), 
Washington, DC. 


EU3U9/1U 


Because ot the unique nature ot college 
transcripts many inconsistencies exist in 
the data which may affect the estimates 
reported. Missing dates for specific terms 
lead to problems in determining length of 
time required to complete a given level. 
Missing transcripts of undergraduates who 
transfer lead to time and credit 
inaccuracies. Schools that were not on 
semesters created problems. 


Manser, M, Pergamit, M., and Bland- 
Peterson, W. (1990). 

National Longitudinal Surveys; 
Hpvplnpment and uses. Monthlv Labor 
Review. 113 (7), 32-37. 


EJ412643 


Strength: 

-Can obtain detailed information on how 
individual’s lives evolve over time 
-Can examine the interaction of a variety 
of economic and social forces 
-Response rates have remained relatively 
high 

-exceptional database for labor market 
analyses due to breadth of information 
collected, event/history format, and the 
high 

retention rate 

-includes child care information 
-considerable information is collected to 
help locate the respondent in subsequent 
years (including family, friends, and 
employer contact information) 


McAdams. K. (1981). National 
longitudinal studv of the high school 


HD21705T 


None cited. 

— 


class of 1972: An historical overview 


andsummarv. Washington, D.C.: 
National Center for Education 
Statistics. 
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Rindtuss, R., Kavee, A, and UooKsey, 
E. (1995). “The First Year after 
College: Activities and their 
Cnhcfqiiftnt Effects.” Journal of Higher 
Education, 66(4):415-446. 


EJ508T63 


“ 1 he pnmary limitation ot tne inl 5 /z is 
the exclusion of those who did not reach 
their senior year of high school.. ..We 
expect that omission of these dropouts 
enhances the social attainments, such as 
wage-eamings, of the sample and leads to 
somewhat later timing of family 
transitions. . ..A second limitation of this 
sample is the sparsity of Hispanic, Native 
American, and other minority 

students As a result, the analyses 

presented here are restricted to the white 
population. Finally, because of budget 
constraints, the 1986 follow-up sampled a 
subset of the original panel members. 
Because of special interests of the various 
funding sources, the following groups 
were retained with certainty: Hispanics, 
teachers and potential teachers, college 
graduates, and persons who had already 
experienced a divorce, widowhood, 
separation, or an out-of-wedlock birth. All 
others were sampled.” 




Kothstein, U.is. (lyyoj. Uo temale 
faculty influence female students’ 
educational and labor market 
attainments? Industrial and Labor 
Relations Review. 48 (3), 515-30. 


HJ5008U9 


Strength: 

-Includes name of the college attended by 
the respondent 

-Includes locational variables 
(respondent’s state of residency) in each 
follow-up through 1979 
-Fourteen year time span of survey 
facilitates analysis (can examine mid- 
career, post-undergraduate labor market, 
and educational attainments) 

Weakness: 

-Individuals in the first four follow-ups 
were included in fifth follow-up 
subsample with unequal probabilities 




Savoca, E. (1990). Another look at 
the demand for higher education: 
Measuring the price sensitivity of the 
decision to apply to college. 
Economics of Education Review. 9 


EJ41 1564 


None cited. 


(2), 123-134. 
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Sharp, L., and Weidman, J. (,l989). 
“Early Careers of Undergraduate 
Humanities Majors.” Journal of Hieher 
Education. 60(5); 544-564 


HJ3968U1 — 


“ There appears to be a rather random 
pattern of missing data throughout the data 
file so that the numbers of missing 
responses vary from one item to 
another... .A second problem has to do 
with the representativeness of the samples 

of majors that are used The NLS72 data 

file did not yield a clean unemployment 
measure, because the category ‘waiting for 
work’ included persons who were looking 
for work as well as persons who were 
‘waiting to report to work.’” 




St. John, E. and Noell, J. (lybyj. me 
Effects of Student Financial Aid on 
Access to Higher Education: An 
Analysis of Progress with Special 
Consideration of Minority 
Fnrnllment.” Research in Higher 
Education, 30:563-581 


EJ407141 


“ There is not a sutticient subsample ot this 
population (Native Americans) in HSB or 
NLS for separate analyses of this 
population. With the databases used for 
this study - the National Longitudinal 
Survey of the High School Class of 1972 
and the High School and Beyond study - it 
is only possible to conduct separate 
analyses of blacks and Hispanics in the 
1980s. NLS did not contain the additional 
sampling of these subpopulations that is 
necessary to analyze these groups 
separately.” 

“There are three limitations that influence 
our ability to analyze the effects of aid 
offers on college attendance decisions. 

One limitation is that high school classes 
are studies infrequently.... A second 
limitation is that the CES data contained 
self-reported data on aid offers. 

Presumably students might not recall their 
exact amount or type of aid offered, 
especially aid offered by schools they did 
not attend. Unfortunately, most databases 
that can be used to assess progress on 
access have this limitations. It would be 
necessary to survey the financial aid 
offices of every college to which a student 
applied to overcome this deficiency. Third, 
there are missing values for many of the 
variables in our statistical models in all 
three surveys.” 




Suter, L K (Ed.) ( 1992). Indicators ot 
science and mathematics education 


■ HU3655ir 


None cited. 


1992. First Edition. Washington, 
D.C.: National Science Foundation 


Thomas, Ci., and (Jordon, S.A. (198J). 
Evaluating the navoffs of college 


ED235733 


None cited. 


investments for black, white, and 


hisoanic students. Reoort No.344. 
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Baltimore, MD: Center tor Social 
Organization of Schools, Johns 
Hopkins University. 






i homas, U.B. (19»1). Choosing^ 
college maior in the hard and technical 


EU206829 


Strength: 

-None cited 
Weakness: 

-Need to include variables which allow 
analyses of the effects of tracking students 
at the secondary school level, particularly 
tracking which may lead to stratification 
of students by race, sex, or social class 


sciences and the nrofessions; A causal 


exolanation. Baltimore, MD: Center 


for Social Organization of Schools, 
Johns Hopkins University. 


1 homas, C.t. ( 198Z). Uetermmins 
the college destination of black 


EU215U31 


Strength: 

-Ability to investigate the college 
destinations of black students 
Weakness: 

-During the base year and subsequent 
follow-up surveys, a limited number of 
questions were asked regarding the type of 
financial aid that students expected to 
receive to support their college education. 
The authors of this study found these 
questions to be inconsistent and unreliable 
and were, therefore, not included 
-Conventional measures of “significant 
others’ influence” are not enough 
-More extensive information is needed 
regarding the impact of HS officials, 
parents, and peers on students’ college 
choice 

-Need more detailed information on 
students’ perceptions and motivations for 
their college choices - this should include 
retrospective data from students currently 
enrolled in various colleges as well as data 
from prospective entering freshmen 


students. Atlanta, GA: Southern 
Education Foundation. 


Transfer from Sub-Baccalaureate to 


ED37T/8/ 


"It IS possible that high school students 
taking part on the PSEO program were 
erroneously counted as new entering 
students." 

"Because of the difficulty of determining 
whether or not an individual truly was a 
new entering student, the analysis includes 
all reported new entering students." 


Baccalaureate Institutions in 


Minnesota Post-Secondarv Education, 


Fall 1984-Fall 1988. 0993.) Minnesota 


Higher Education Coordinating Board, 
St. Paul. 


Tuma. J.E. (Apnl 1989). Secondarv 
schools. Course enrollment oattems in 
public. 1969-1987. 


EU3 15545 


Strength: 

Limitation: 

Does not include high school transcript 
data. 
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'ED37219 1 1 Authors cite an increased demand lor dat^ 
to measure the current scale and scope of 
how and when the nation invests in the 
educational quality of the workforce, and 
include recommendations focused on 
constructing more reliable instruments. 



Zemsky, Robert; bnapiro, JJaniel. 
(1994.) On Measuring a Mirage: Why 
U.S. Training Numbers Don't Add Up 
EQW Working Papers WP20. Office 
of Educational Research and 
Improvement (ED), Washington, DC. 



NPSAS 



Andrew, Loyd D.; Kusso, Kocco",. 
Who Gets \^at? Impact Of Financial 
\id Policies. 



1 hD3uy/i/ 1 


None cited. 


ED342j0r 


None cited. 


1 1 


NPSAS contains tall enrollees only, this 
creates problems comparing NPSAS data 
to federal aid award reports. 




NPSAS8 / contains only tall 86 enrolleesj 
while NPSAS90 contains enrollees 
throughout the 89-90 academic year. 


s 


None cited! 


|jJEI53j//2o 


I he purpose of this report is to present 
data from the 1 990 NPSAS survey. 

Although both report have a similar 
format, the data contained in them are not 
comparable, because the design of the I 

samples in the two surveys is different. 

The earlier NPSAS surveyed a sample of 
students from the fall term and therefore 
presents data only on those students who 
were enrolled in that term, while the 1990 
NPSAS provides information about 
students who were enrolled throughout the 
academic year. 1 



Apiing, ratiioiu i'.. — 

Students Attending Postsecondary 
Institutions. CRS Report for 

Con gress. 

Bnck, J. Michael. (1989.) Comparison 
of Fall and Academic Year Student 
Aid Estimates. 1987 National 
Postsecondary Student Aid Study. 
Contractor Report. Technical Report. 
National Center for Education 
Statistics (ED), Washington, DC. 

Byce, Chuck; Knazzoom, Aziza. 
(1993.) Changes in Undergraduate 
Student Financial Aid: Fall 1986 to 
'all 1989. National Postsecondary 
Student Aid Study. Statistical Analysis 
Report. Contractor Report. U.S. 
Government Printing Office, 
Superintendent of Documents, Mail 
Stop: SSOP, Washington, DC 20402- 
9328. 

Byce, Chuck; Schmitt, Carl 
Students at Less-Than-4-Year 
Institutions. National Postsecondary 
Student Aid Study. Statistical Analvs 
Report. Contractor Report. 

Byce, Chuck; scnmitt, uari 
Undergraduate Education: 1990. 
National Postsecondary Student Aid 
Study. Statistical Analysis Report. 
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(Jhoy, Susan B.. Characteristics ot 
Students Who Borrow To Finance 
Their Postsecondary Education. 
Postsecondary Education Descriptive 
Analysis Reports. Statistical Analysis 
Report. 


ED3777’/S"' 


None cited. 


Choy, Susan P., and Uittord, 
Antoinette G. (1990.) Profile of 
Undergraduates in American 
Postsecondary Institutions. Survey 
Report. National Center for Education 
Statistics, Washington, DC. 


,r.JJ32!)483 


“Because the NPSAS data were collected 
in the fall, they do not represent all 
students who enrolled in a postsecondary 
institution during the 1986-87 school year. 
Students who did not enroll until after the 
iall term or who enrolled in short term 
irograms not in session at the time of the 
data collection are not represented in the 
sample.” 


Choy, Susan P.; And Others, student 
Financing of Graduate and First- 
Professional Education, 1992-93. with 
an Essay on Student Borrowing. 
National Postsecondary Student Aid 
Study. 1992-93. Statistical Analysis 
Report. 


ED389241 


None cited. 


Choy, Susan P.; Henke, Robin K. 
(1992.) Parental Financial Support for 
Undergraduate Education. National 
Postsecondary Student Aid Study, 
Research and Development Report. 
Contractor Report. U.S. Government 
Printing Office, Superintendent of 
Documents, Mail Stop; SSOP, 
Washington, DC 20402-9328. 


ED345623“ 


Parents of students aged 2i or older are 
not included. NPSAS87 only includes 
students enrolled on 15 October 1996. 


Choy, Susan P.; Premo, Mark U.. How 
Low Income Undergraduates Financed 
Postsecondary Education; 1992-93. 
Postsecondary Education Descriptive 
Analysis Reports. Statistical Analysis 
Report. 


ED3944/3 


None cited. 


Davis, Jerry S., Ed.. Proceedings tor 
the Annual Conference of the 
NASSGP/NCHELP Research 
Network (6th, Washington, D.C., June 
7-9, 1989). 


"ED3398H7" 


In approaching a study with NPSAS 87 
data one should remember their 
limitations — they are cross-sectional and 
cover only one point in time. To facilitate 
research on Hispanic students’ 
educational financing, in the next NPSAS 
survey the list of nationalities of 
Hispanics should include Central and 
south Americans. The expansion of the 
sample of NPSAS 90 institutions to 
included those in Puerto Rico should 
provide much better data on Puerto Rican 
stduents. 


Dynarski, Mark. Analysis ot Factors 
Related to Default. 


■ ED35480r 


None cited. 


Dynarski, Mark. Who Defaults on 


■ HJ4833yU“ 


Additional research may be helpful to 
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student Loans? bindings trom me 
National Postsecondary Student Aid 
Studv. Economics of Education 
Review, vl3 nl p55-68 Mar 1994 . 




gam a better understanding ot the tactors 
leading to higher default rates among 
minority groups. 


Eitzgerald, Robert; And Utners. 
Descriptive Summary of 1989-90 
Beginning Postsecondary Students: 
Two Years Later. Contractor Report. 
Statistical Analysis Report. 


LD3 72691 


None cited. 


Flint, I homas. Legacies ot Paying ior 
College. AIR 1995 Annual Forum 
Paper. 


ED387012 


None cited. 


(jreene, Bernard; Zimbler, Linda. 
(1989.) Profile of Handicapped 
Students in Postsecondary Education, 
1987. National Postsecondary Student 
Aid Study. Survey Report. 
Superintendent of Documents, U.S. 
Government Printing Office, 
Washington, DC 20402 


ED310616” 


NPSAS allows sell reporting ot 
disabilities. Questions and data in this 
regard may differ from other sources. 


Horn, Laura J.; And Others. Protiie ol 
Undergraduates in U.S. Postsecondary 
Education Institutions: 1992-93. With 
an Essay on Undergraduates at Risk. 
Statistical Analysis Report. 


HD392852” 


None cited. 


Horn, Laura; Maw, Larlyle. Minonty 
Undergraduate Participation in 
Postsedondary Education. Statistical 
Analysis Report. 


EU3832'/r 


In the survey, Asian/Facitic Islanders and 
Hispanic students were asked for their 
specific subgroup identity. However, 
those who chose not to identify 
themselves, those belong to groups too 
small to be disaggregated, or students of 
mixed identify were categorized as 
“other/non-specified” . 


Horn, Laura; Maw, Carlyle. 
Undergraduates Who Work While 
Enrolled in Postsecondary 
Education: 1989-90. Contractor 
Report. 


LU37472/ 1 


None cited. 


Korb, Roslyn, And Others. (1988.) 
Undergraduate Financing of 
Postsecondary Education. A Report of 
the 1987 National Postsecondary 
Student Aid Study. Analysis Report. 
National Center for Education 
Statistics (ED), Washington, DC. 


HD298819“ 


NPbAb87 does not represent entire year s 
enrollment. 


Korb, Roslyn, And Others. (1989.) 
Student Financing of Graduate and 
Professional Education. A Report of 
the 1987 National Postsecondary 
Student Aid Study. Analysis Report. 
Superintendent of Documents, Mail 
Stop: SSOP, Washington, DC 20402- 
9328. 


■ ED30972r 


NP8Ab87 does not represent entire year s 
enrollment. Only about 70% of students at 
traditional 4 year colleges and universities 
enroll in the fall. 
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Lee, John B.; Ulery, suanne B.. 
Packaging of Undergraduate Student 
Financial Aid: 1989-90. Postsecondary 
Education Descriptive Analysis 
Reports. Statistical Analysis Report. 


ED386U83 


None cited. 


Malizio, Andrew Ci.. National 
Postsecondary Student Aid Study: 
Estimates of Student Financial Aid 
1992-93. E.D. TABS. 


ED38429Z 


Two design teatures ot the 1993 NPSAS 
sample suggest that the estimates in this 
tabulation, while generally comparable to 
NPSAS 90, are not comparable to 
published estimates from the 1987 
NPSAS. These design changes were made 
to the 1990 NPSAS to improve full- year 
estimates. The 1987, and 1990 NPSAS 
sampled students enrolled in the fall 
(October). However, the 1990 NPSAS 
also sampled students who were enrolled 
in the summer (August), Winter 
(February), and spring (June). In NPSAS 
93, institutions were asked to provide one 
list (if possible), that represented students 
enrolled at any time during 1992-93 
academic year. 

The 1990 and 1993 NPSAS samples also 
included a small sample of students from 
Puerto Rico. Students from Puerto Rico 
were not included in the 1987 NPSAS. 


Malizio, Andrew U.. Who Uets 
Financial Aid? And Why Low-Income 
Students Don't Apply for Student 
Aid?: Key Findings from the National 
Postsecondary Student Aid Study. 


EU3629b9 


Students from Puerto Rico were not 
included in the 1987 NPSAS. 


Marshall, Robert E. (1989.) Uuide to 
Databases Containing Data on 
Vocational and Adult Education 
Maintained by the U.S. Department of 
Education. Office of Vocational and 
Adult Education (ED), Washington, 
DC. 


ED31125 / ■ 


NPSAS87 does not represent entire year's 
enrollment, but just fall 1986 students. 


McCormick, Alexander C.; And 
Others. Profile of Part-Time 
Undergraduates in Postsecondary 
Education: 1989-1990. Postsecondary 
Education Descriptive Analysis 
Reports. Statistical Analysis Report. 


bU38bll7 


None cited. 


Millett, Cathenne M.; MacKenzie, 
Susan. An Exploratory Study of the 
Role of Financial Aid in Minority 
Doctoral Education. ASHE Annual 
Meeting Paper. 


ED391411 


While cross-sectional data like NPSAS 
does give us a sense of what is happening 
to these students at one point in time, it 
does not allow generalizations about many 
of the pressing issues such as the financial 
aid role in time to degree and completion 
rates overall. A followup of the same 
individuals would represent a significant 
leap forward in this area, allowing 



124 



NCPI Project 5.3, 06/12/97 



42 







researchers to till in these gaps. j 


Net Cost ot Attending Postsecondary 
Education. Indicator of the Month 


ED387026" 


None cited. I 


Researcn bindings trom tne 198/ 
National Postsecondary Student Aid 
Study. 


EU35U94J 


None cited. 


Ross, Laurent; And (Jtners. Pederai 
Student Aid Packages; Academic Year 
1 1986-87. 




None cited. 


St. Jonn, Edward P. and otners. me 
Influence of Prices on within-Year 
Persistence by Traditional College- 
Age Students in Four-Year Colleges. 
Toumal of Student Financial Aid, v22 
1 nl p27-38 Win 1992 


EJ 448777” 




St. John, Edward P.; And Utners. me 
Influence of Prices and Price 
Subsidies on Within-Year 
Persistence by Students in Proprietary 
Qrhnnk Educational Evaluation and 
Policy Analysis. vl7 ti2 pl49-65 
Suml995 . 


EJ5 11049 


NPSAS-8 / does have a tew limitations lor 

persistence research on proprietary 

schools. First, NPSAS-87 did not include 
all the types of information that would be 
needed for an “ideal” persistence study. 

The national longitudinal studies have 
included additional variables related to 
ligh school experiences (e.g., grades, test 
scores, and academic track), but these data 
were not available from NPSAS-87. 

Second, there were missing values for the 
variables in the model. 

Third, because NPSAS-87 was a fall 
sample, it was not representative of all 
college students. This was a more serious 
problem for proprietary schools than for 
other types of colleges, because students 
often enroll in proprietary schools at times 
other than the fall semester. Thus the 
reader is reminded that this sample, even 1 
with the use of sample weights, is not 
necessarily representative of all students 
attending proprietary schools. Rather, it is 
representative of the population of 
proprietary students who enrolled at the 
start of the fall semester. 

Fourth, some fall enrollees were excluded 
from the sample because of NPSAS-87 
data collection procedures. Any student 
enrolled in fall 1986 who was no longer 
enrolled at the time of data collection was 
not included in NPSAS-87. As a result, 
some early dropouts were not included in 
the study. 

Fifth, because most students with work 
study responded affirmatively to the 
question asked about current work, there 
1 was an overlap between the economic \ 
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background vanables tor working and the 
receipt of college word study. 


i>t. John, tdward P. and others. Ihe 
Nexus Between College Choice and 
Persistence. Research in Higher 
Education, v37 n2 pl75-220 Apr 1996 


"EJ323U7T~ 


First, the NPSAS-K / database did not 
include measures of precollege student 
ability such as school grades or entrance 
test scores that have been used in many 
persistence studies. 

Second, although NPSAS-87 did include 
some indicators of the social and 
academic integration processes in the 
Tinto and Bean frameworks — such as on- 
campus residence, attendance at private 
colleges, years in college, and college 
grades (all included in this study — 
comprehensive measures of social and 
academic integration were not available. 
Third, although there were some missing 
values for each of the variables included 
in the study and students with missing 
values for one or more variables had to be 
excluded, the number of missing values in 
NPSAS-87 is small. 

Fourth, NPSAS-87 was a sample of 
students identified in the fall semester 
and, therefore, was not representative of 
college students who enrolled in the 
spring semester. This could have been a 
more serious problem in a study of 
students attending two-year colleges and 
proprietary schools where more students 
enroll in the spring 

semester.... Furthermore, students who 
enrolled in a college at the beginnmg of 
the fall semester, but dropped out before 
the time of data collection in the first half 
of the fall semester, were not included in 
the sample. This means some very early- 
semester dropouts were excluded from the 
analysis. 

Fifth, when a sample student is at 
extremely high or low values on other 
independent variables, the validity of the 
estimated effect of the variable on the 
probability of persistence(delta-p) is 
reduced. The delta-p measure is of 
questionable validity when sample 
members are at extremes on other 
variables. This condition warrants the use 
of caution in the application of the delta-p 
statistic in extreme cases. 


• 


St. John, Edward P. Andneu, Sandra 
Carlin. The Influence of Price 
Subsidies on Within-Year Persistence 


■ HJ50332^ 


First, NPSAb-8 / does not include all ot 
the variables needed to predict 
persistence. Ideally a model of graduate 
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■>y (iraduate Students. Hieher 
Education. v29 n2 p 143-68 Mar 1995. 




student persistence would also include 
information on undergraduate student 
achievement, but unfortunately this type 
of information was not collected as part of 
NPSAS-87. 

Second, there were missing values for 
each of the variables included in the 
model. 

Third, NPSAS-87 was a fall sample and 
was not representative of all college 
students. 

Fourth, some fall enrollees were excluded 
from the sample due to the data collection 
procedures used in NPSAS-87. Any 
student enrolled in a postsecondary 
institution in fall 1986 who was no longer 
enrolled at the time of the data collection 
was not included in NPSAS-87. This 
means some early drop outs were not 
included in the study. 

Fifth, there was an overlap between the 
background variables for working and the 
receipt of graduate assistantships. This 
happened because most students with 
assistantships responded affirmatively to 
the question asked about current work. 1 




St. John, Edward F.; Starkey, Jonnny 
B.. The Influence of Costs on 
Persistence by Traditional College- 
Age Students in Community Colleges. 
Community Colleee Journal of 


EJ4/99U9 


First, NPSAS-8 / does not include all ot 1 
the variables needed for an ideal 
persistence model. In particular, variables 
related to standardized test scores and 
high school grades are missing. These 
missing variables are not considered 
sufficiently problematic as to detract from 
the analysis of the influence of prices on 
persistence. 

Second, NPSAS-87 sampled students a 
few weeks after the start of the fall 
semester, therefore missing some students 
who enrolled initially then dropped out. 
Third, NPSAS-87 was a fall sample with a 
spring follow-up student survey. This 
sampling procedure missed some students 
who enrolled in the spring for the first 
time, s phenomenon that is more common 
at community colleges than 4-year 
colleges and universities. Our findings 
may not be applicable to students who 
enroll for the first time in the spring. 


Research and Practice, vl8 n2 p201- 


13 Mar- Apr 1994 . 


Stowe, Peter; ZimPler, Linda";. 
Characteristics of Stafford Loan 
Recipients, 1988. 1987 National 
Postsecondary Student Aid Study, 
E.D. Tabs. 


■ HD32285^ 


Estimates tor the m-school portion ot H 

NPSAS are based on students enrolled in 
postsecondary education in the fall of 
1986, rather than for the entire 1986-87 
school year. 1 
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btowe, Peter;. Undergraduate 
Financial Aid Awards; A Report of the 
1987 National Postsecondary Student 
Aid Study. Analysis Report 


ED326145"' 


Because the sample is ot students enroliea 
in the fall, it does not represent all 
students enrolled in a postsecondary 
institution at all times during the 1986-87 
school year. 


Student Aid and the Cost ot 
Postsecondary Education. A CBO 
Study 


ED329158 


The data collected in the 1987 NPSAS 
were only on students enrolled in the fall 
of 1986, and hence are not representative 
of all students enrolled over the 1986-87 
academic year. 


Student Education Expenses, 1987. 
1987 National Postsecondary Student 
Aid Study. E.D. Tabs 


EU3Uy/ll 


None cited. 


i’rammell, Mary Louise. Estimating 
the Enrollment Effects of a Mid-Year 
Surcharge: Using National Price 
Response Measures in Institutional 
Planning. AIR 1994 Annual Forum 
Paper. 


ED37366U 


None cited. 


Tuma, John E., And Others, (lysy.) 
Student Financial Aid and 
Postsecondary Vocational Education. 
National Assessment of Vocational 
Education (ED), Washington, DC. 


ED3 15542 


NPSAS87 underestimates numbers ot 
students in programs that do not follow the 
traditional academic term pattern, 
particularly vocationally-oriented 
programs. 


luma, John. Patterns ot Enrollment in 
Postsecondary Vocational and 
Academic Education. Journal of 
Vocational Education Research. vl9 
n3 pi 07-30 1994 


EJ507747“ 




luma, John; And Others. Student 
Financing of Undergraduate 
Education, 1992-93, with an Essay on 
the Costs of Undergraduate Education 
before and after Student Financial Aid. 
National Postsecondary Student Aid 
Study; 1992-93. Statistical Analysis 
Report. 


EU38924U 


None cited. 


Undergraduate College Financing m 
New York State. A Report of the New 
York State Augmentation of the 1987 
National Postsecondary Student Aid 
Survey. Executive Summary 


ED321719 


Untbrtunately, the sample for CUNY 
community colleges was too small to be 
reliable and, therefore, no information on 
CUNY community college students is 
included in this report. 


Undergraduate College Financing m 
New York State. A Report of the New 
York State Augmentation of the 1987 
National Postsecondary Student Aid 
Survey 


ED3217W 


Ibid. 


Volkwem, J. Fredencks; And Others. 
Characteristics of Student Loan 
Defaulters among Different Racial and 
Ethnic Groups. AIR 1995 Annual 
Forum Paper. 


■ ED386972 


Research is needed on the dynamics ot 
marital status and family size as 
influences on loan default. Our measures 
of marital status and family size are at the 
time of first loan repayment or default. 
We do not know the marital status or 
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family size at the time ot enrollment. 


Volkwein, J. hreaencks; bzeiest, 
Bruce P.. The Relationship of Student 
Loan Default to Individual and 
Campus Characteristics. AIR 1994 
Annual Forum Paper. 


ED373616 


in over 1 100 cases, the missing IP EDS 
and college Board information involves 
borrowers who attended proprietary 
institutions. This limits some of the power 
of our analysis. 


Yankosky, Richard b.; Andrew, Loyd. 
The Proprietary School Sector; A 
Demographic and Financial Aid 
Profile 


bD33UZ09“ 


None cited. 
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Bnck, J. Michael, and Uthers. (. 1994 .) 
A Study of Selected Nonsampling 
Errors in the 1991 Survey of Recent 
College Graduates. Technical Report. 
U.S. Government Printing Office, 
Superintendent of Documents, Mail 
Stop: SSOP, Washington, DC 20402- 
9328. 


ED379314" 


Sampling errors in the KCLi are due lo 
nonresponse, random measurement errors, 
and systematic errors due to interviewers. 
Sampled units that do not participate in 
survey are a source of bias. 


Stowe, Peter. ( 1993.1 Estimates or 
1985-86 Bachelor's Degree Recipients' 
Course-Taking Behavior. Recent 
College Graduates Study. National 
Center for Education Statistics (ED), 
Washington, DC. 


ED3 54809" 


Many institutions and individuals refused 
to release their transcripts, or did not 
respond to requests for transcripts. 
Sampling error may result from using a 
sample of bachelor’s degree recipients’ 
transcripts rather than the transcripts of all 
bachelor’s degree recipients. Some 
transcripts had missing course titles. 



2. Faculty data sets 



ACE-72 



Leverenz, '1 heo K. and Lewis, bruce 
R. (1981). An Analysis of Faculty 
Consistency in the Academic 
Professions. 



ED2U1254' 



None cited. 



HERI Faculty Survey 
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Arredondo, M. (1995). Paculty- 
student interaction: Uncovering the 
types of interactions that raise 
undergraduate degree aspriations. 
Paper presetned at the Annual Meeting 
of the Association for the Study of 
Higher Education, Orlando, FL. 


HD391423“' 


Need longitudinal data on taculty 
interaction to merge with student data to 
prove or disprove causation. 

(HERI faculty data used as a merge with 
CIRP.) 


Dey, E. L. & Hurtado, S. (1996). 
Faculty attitudes toward regulating 
speech on college campuses. Review 
of Hieher Education. 20(1), 15-32. 


EJ53262U 


h acuity attitudes measures are otten only 
single-item questions measuring broad 
areas or constructs 

Data is cross-sectional, so cannot deduce 
cause and effect relationships 

Response bias, which is corrected for with 
weights 

Lacking measures on campus dynamics 
related to context, such as historical legacy 
or institutional traditions of racism/sexism, 
history of activism, and institutional 
decision making process 


Uey, E. L., Kom, J. S., & bax, L. J. 
(1996). Betrayed by the academy: 
The sexual harassment of women 
college facultv. Journal of Higher 
Education. 67(2). 149-73. 


EJ52U133 


Only has single-item measure ot 
harassment and no information on timing, 
nature, or severity of harassment 
experience, status of harassment, nor the 
number of times harassment was 
experienced 

Not longitudinal, so cannot uncover 
history of harassment 


Hurtado, S., Carter, U. h. & bharp, S. 
(1995). Social interaction on campus: 
Differences among self-perceived 
ability groups. Paper presented at the 
Annual Forum of the Assocation for 
Institutional Research, Boston, MA. 


EU387U14 


None cited. 

(HERI faculty data as a merge with CIRP.) 


Opp, R. D. (1994). Promoting a talent 
development view of excellence for 2- 
vear colleges. Communitv College 
Journal of Research and Practice, 

18(3), 279-88. 


EJ485343 


None cited. 


I sui, L. (1995). Boosting temale 
ambition: How college diversity 
impacts graduate degree aspirations of 
women. Paper presented at the Annual 
Meeting of the Association for the 
Study of Higher Education, Orlando, 
FL. 


■ HD39l429“ 


None cited. 

(HERI faculty data used as a merge with 
CIRP.) 
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NSOPF 



Blackburn, Kobert and Utners. (1994). 
Minority vs. Majority Faculty 
Publication Performance; A Research 
Note. Review of Higher Education, 
vl7n3p271-82 Spr 1994 


HJ481734“ 


In the social knowledge domain, how 
much time faculty believe their 
organization wants them to devote 
research is a consistent predictor of 
output. The variables, unfortunately, are 
not contained in the NSOPF88 survey for 
in any other survey than NCRIPTAL’s. 


Fairweather, James b. and KJioaas, 
Robert A. (1995). Teaching and the 
Faculty Role; Enhancing the 
Commitment to Instruction in 
American Colleges and Universities. 
Educational Evaluation and Policy 
Analysis, vl7 n2 pl79-94. Sum 1995. 


EJ511UiI~ 


Longitudinal data are better suited tor 
estimating relationships between early 
socialization and later performance. 
Although percentage of time spent on 
instruction does reflect effort and 
commitment above and beyond work 
requirements, the measure is an imperfect 
indicator of commitment to teaching. 


Pollicino, Elizabeth A. (1996). l^acuity 
Satisfaction with Institutional Support 
as a Complex Concept; Collegiality, 
Workload, Autonomy. Paper presented 
at the Aimual Meeting of the 
American Educational Research 
Association (New York, NY, April 8- 
13. 1996V 


EU39442ir 




3. Institutional data set 
IPEDS 


Barbett, S. & Korb, R. A. Current 
Funds Revenues and Expenditures of 


■ ED374726 


bTRENCi i n; Revenue ana expenses 
lines are totaled and checked against 
Grand Total lines. Inconsistencies are 
followed-up on with the respective 
institution. Specific imputations are 
detailed in appendix— imputations only 
used for this report. 


Institutions of Hieher Education: 
Fiscal Years 1984 through 1992. E.D. 
Tabs. 
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Barnes, Michael W. (1993). 
Expenditure Data and Their Accuracy 
for Peer Institutional Comparisons. 


ED373681 


I'his study lound that error is still present 
and that the improvement predicted in the 
1970’s has not yet occurred. Institutions of 
higher education probably will never 
report expenditure data in a totally 
accurate manner, regardless of the rigidity 
of the guidelines. An analysis of data from 
the nine institutions that provided any 
information found discrepancies in 
reporting computing, academic 
administration, retiree and staff benefits, 
registration, and campus security and 
safety. It did not find public relations 
activities, and admissions. 


Brown. P. O. Salanes ot huil-time 
Instructional Faculty on 9- and 10- 
Month Contracts in Institutions of 
Higher Education. 1982-83 through 
1992-93. E.D.Tabs. 


ED3672U2 


N/A, but does give detailed mlormation 
about imputations designed for the study 
that may be of benefit in future studies. 


Brovles. S. Ci. (Jharactenstics ot the 
Nation’s Postsecondarv Institutions: 
Academic Year 1992-93. E. D. Tabs. 


ED365265 


None cited 


Broyles. S. G. &, Morgan, h. B. Basic 
Student Charges at Postsecondarv 
Institutions: Academic Year 1992-93. 
Tuition and Required Fees and Room 
and Board Charges at 4-vear. 2-vear, 
and Public less-than-2-vear 
institutions. Statistical Analysis 
Report. 


ED365261 


N/A - Only summary statistics on student 
charges at PSIs. 


Cohen, Michael P. (1988.) Error 
Analysis of Estimates for Less-Than- 
Two-Year Postsecondary Education 
Institutions. 


ED324353 


“ The reluctance of (less than two year) 
institutions to respond, the volatile nature 
of the population, the highly skewed 
distribution of sizes of the institutions, the 
sensitivity of the data to precise 
definitions, among other issues, all 
contribute to the difficulties (to get 
statistics).” 


Fall Eiuollment m Postsecondary 
Institutions: National Estimates for 
Fall 1987 and Reported Data for Fall 
1986. Survey Report. 


ED299942 


Extremely small sample size for pnvate 2- 
year institutions and standard errors large 
for that group. Eiuollment data at <2-year 
institutions not collected by attendance 
status. Students eiuolled in non-credit 
courses, students purely auditing for-credit 
courses, and students studying abroad not 
counted in eiuollment figures. 


Henderson, Cathy. (1993.) A 
Contemporary Profile of Baccalaureate 
Colleges. Research Briefs . 4(5). 


ED382U84 


"Histoncally, response rates have been 
consistently high. (1978-1979 through 
1991-1992 - 69%-95%)""All proprietary 
schools have been excluded from this 
analysis." (Unclear whether this has been 
done by IPEDS collectors or by the 
researchers for this study.) 
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Hiirtadn, SI. & uthers. Latino btuaent 
Transition to College: Assessing 


ED373bb3 


No limitations referenced. Pnmary dataset 
used in study was National Survey of 
Hispanic Students. 


Difficulties and Factors in Successful 


College Adjustment. 1994 AIR 


Annual Forum Paper. 


Ingram, John A. (1995). Using lPUhS“ 
Data for Selecting Peer Institutions. 

AIR 1995 Annual Forum Paper. 


ED38/U1U 


None cited. 


Ortield, Cary; Paul, Faith U. (1992.) 
State Higher Education Systems and 


ED354U41 


p b-7: "All ot the state level data was 
aggregate because Indiana was the only 
state with an individual level data base, 
which was very recent and still limited in 
important respects. We were, therefore, 
limited to descriptive statistics rather than 
multivariate regression or other methods in 
this first phase of the research." 


College Comoletion. Final Report to 


the Ford Foundation. Ford Foundation, 


New York, N.Y. 


Pena, Ueageha M. (1994). Factor 
Scores from Higher Education Finance 
Variables as Indicators of Salary. 
Presented at the AERA Annual 
Conference, New Orleans, Lousiana, 
April 5, 1994. 


ED381U9U 


Ihe multiplicity ot vanables descnbmg the 
financial conditions of post secondary 
institutions in the nation makes it difficult 
to assess changes in higher education 
finance from year to year. 


Piuta. M. J. National Higher 
Education Statistics: Fall 1991. Early 


ED34U314 


None cited 


Estimates. 


Piiita M. M. National Postsecondary 
Statistics. Collegiate and 


ED35U954 


<2-year institutions are not surveyed on a 
“census” basis but on a sample basis. 
Weights for this populations are based 
upon “average” institutions. 


Noncollegiate: Fall 1991. Early 


Estimates. 


Schantz, N. B., Brown, P. 0- Irends 
in Racial/Ethnic Enrollment in Higher 


EU322834 


Racial/ethnic data pnor to 198b was 
underreported/nonreported. Prior to 1984, 
in cases where the institution provided no 
racial/ethnic data, IPEDS imputed data 
from previous years. Students attending 
postsecondary institutions on a non-degree 
seeking basis were not included in the 
data. 


Education: Fall 1978 through Fall 


1988. Suryey Report. 


Schantz. N. P. Fall Enrollment in 
Institutions of Higher Education^, 


ED315U1/ 


1987 data were imputed tor total non- 
respondents (9.2% of HEGIS institutions) 
and for institutions that did not respond to 
specific items, based upon prior year 
responses. Some individual item non- 
responses were hot deck matched. Students 
enrolled in non-credit courses, students 
purely auditing for-credit courses, and 
students studying abroad not counted in 
enrollment figures Students enrolled in 
non-credit courses, students purely 
auditing for-credit courses, and students 
studying abroad not counted in enrollment 
figures. STRENGTH: All data edited for 
addition errors and for consistency with 
prior year’s responses. 


19871. Survey Report. 
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Williams. J . Academic Libranes; 
1990. E.D. Tabs. 



EU355943 1 N/A into on academic libranes 




134 




U.S.fDepCiffment of Education 

Office of Educational Research and Improvement (OERI) 
National Library of Education (NLE) 
Educational Resources Information Center (ERIC) 




ji 



NOTTCE 

REPRODUCTTON BASIS 




This document is covered by a signed “Reproduction Release 
(Blanket) form (on file within the ERIC system), encompassing all 
or classes of documents from its source organization and, therefore, 
does not require a “Specific Document” Release form. 




This document is Federally-funded, or carries its own permission to 
reproduce, or is otherwise in the public domain and, therefore, may 
be reproduced by ERIC without a signed Reproduction Release form 
(either “Specific Document” or “Blanket”). 




EFF-089 (9/97) 





